MEDIUM WHEREON IMAGE DATA TNTK R JP.OI .A 7-T ON. . P *}&&P3±M MAS BEEN 
RECORDED, IMAGE DATA INTERPOLATION METHOD, ANjD 
IMAGE DATA INTERPOLATION APPARATUS 



BACKGROUND OF THE INVENTION 



1. Field of the Invention 

The present invention relates to a medium whisreon an 
itudye Udta interpolation program nas been recorded, an inage data 
interpolation method, and an image data interpolation apparatus , 

2. Description of Related Art 

When an image is processed by a computer, it is 
represented in dot matrix pixels, with each pixel havirg a tone 
value. On the screen of a computer, for example, a photograph 
or a computer graphics image is often represented in 640 dots 
of pixels in the horizontal direction and 480 dots of pixels in 
the vertical direction. 

! 
I 

Meanwhile, the performance of color printers lias been 
enhanced remarkably with very dense dots such as 720 dpi (dots 
per inch) r achieving high precision printing* When such printer 
prints an image represented in pixels of 640 dots by '180 dots 
with dot-to-dot correspondence, the printed corresponding image 
would be very small. In this case, because the im4ge data 
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generated on the computer and the printed image diffe 



r in the 



tone values and what is meant by resolution, pixels sjhould be 
interpolated between the dots generated on the computer J thereby 
converting the image to printing image data. Specifically, if 
the printer prints a smaller image from the image data with 
dot-to-dot correspondence, multiplying the pixels of the image 
should be performed (this is referred to as conversion to higher 
resolution or image enlargement) . Inversely, if the printer 
prints a larger image, reducing the pixels of the image should 
be performed (this is referred to as conversion to lower 
resolution or image reduction) . 

As conventional methods of interpolation of dots in such 
cases, the following are known; nearest neighbor interpolation 
(hereinafter referred to as a nearest method) , cubic convolution 
interpolation (hereinafter referred to as a cubic method) f and 
a pattern matching method. These interpolation methods have 
their specific feature. For example, the cubic method enables 
image interpolation without affecting the tone gradat:.on of a 
source image, though the amount of arithmetic processing is large . 
Thus, this method is generally suitable for image interpolation 
of a natural picture consisting of multi-tone pixels. The 
pattern matching method enables interpolation by which the 
contours in an image are sharpened, though tending to af ::ect the 
tone gradation of a source image. Thus, this method is generally 
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suitable for image interpolation of logos and illustrations with 
a small number of tones . 



To apply interpolation to image data, 'based or 
printer prints a good image, conventionally, the 



matching method is used if the image to which interpolation is 
to be applied is regarded as the one belonging to Isgos and 
illustrations, and the cuhi r. Tn<=>fhod is used if such image is 
regarded as the one belonging to natural pictures. However, it 
is generally not easy to judge automatically and correctly 
whether the attribute of an image is the one belonging to logos 
and illustrations or the one belonging to natural pictures. Due 
to Incorrect judgment, sometimes, unsuitable interpolation 
execution has occurred. Discrimination between natural 
pictures and logos or illustrations is not absolute and objects 
that sharpening the contour is desirable may exist in a natural 
picture image. 

Even if interpolation processing suitable |for the 
attribute of an image is performed, it is useless tjo apply 
interpolation for natural pictures by which subtle tune 
gradation is reproduced to an image to be printed by low quality 
setting* : 



which a 
pattern 
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An object of the present invention, produced by cpur study 

i 

i 

efforts to solve the above problem, is to provide a mediuijt whereon 
an image data interpolation program has been recorded, an image 
data interpolation method, and an image data interpolation 
apparatus that prevent incorrect selection of an interpolation 
method, based on the appraised attribute of the image for which 
interpolation is executed, and enable proper interpolation 
processing suitable for print quality. 

As a constitution of the present invention, contrived 
to attain the above object, one aspect of the invention is a medium 
whereon an image data interpolation program has been Recorded 
to implement pixel interpolation to image data of a.n image 
represented in multi-tone dot matrix pixels on a computi 
medium with the above program recorded thereon, after b- 



ready for use on a computer, makes the computer perform; a 



2r , 



The 
2ing set 



function of image data acquisition that acquires image 



data; a 



first interpolation processing function that interpolates 
pixels to the image data without decreasing the degree of tone 
value difference between the existing pixels; a second 
interpolation processing function- that interpolates pixels -to 
the imacre data without- f prt -\ r>o ^ rrrarishi An of <tH« 
the image; a first function of determining a blending rai:io that 
appraises the attribute of the image f based on reference pixels 
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around cl pix^I ul Larger of interpolation and determines a 
blending ratio between pixel interpolations generated by the 
first interpolation processing and those generated by the second 
interpolation processing, based on the appraised attribute; a 
function of image data blending that blends the image data of 
interpolations generated by the first interpolation processing 



function and the corresponding data generated by the 



interpolation processing function at the determined olending 
ratio; and an image data output function that outputs the thus 
blended data as interpolation-processed image data. 

In the invention constituted as above, an initial step 
for making a computer perform pixel interpolation to image data 
represented in multi-tone dot matrix pixels is that image data 
is acquired by the image data acquisition function. 
Interpolation processing to the acquired image data can be 
executed by the first interpolation processing function and the 
second interpolation processing function. The first 

interpolation pror.p.ARTng function interpolates pixels to the 
image data without decreasing the degree of tone value difference 
botvfeen the «xi*LXu.y ^lxtii&i , The secono interpolation 
processing function interpolates pixels to the image data 
without affecting the gradation of the tones of the image. 

The first function of determining a blending ratio 
appraises the attribute of the image, based on reference pixels 



second 
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around a pixel of target of interpolation and determines a 
blending ratio between pixel interpolations generated by the 
first interpolation processing and those generated by the second 

interpol a t i nn nrnr-cs sing, based on the appraised attribute , The 
function of image data ■ biendiny blends the image data ot 
interpolations generated by the first interpolation prbcessing 
function and the corresponding data generated by tha second 



interpolation processing function at the blendin 



g ratio 



determined by the first function of determining a blending ratio 
Then, the image data output function outputs the thus blended 
data as interpol ati nn-nrocesssd imsge data. Thu3, the present 
invention enables two modes of interpolation processing by means 
of the first interpolation processing function and thfe second 
interpolation processing function. The pixels of imige data 
intcipuldiea toy born functions are blended at a ratio that 
reflects the attribute of the image. Thus, ther^ is no 
possibility that incorrect judgment is made as to whether logos 
or natural pictures to which the image for which interpolation 
is executed belongs , causing the execution of only interpolation 
processing that is unsuitable for the interpolation of that 
image; i.e., a decisive error in selecting an interpolation 
method is eliminated 



The above first function of determining a blending 
however, not only sets a ratio between pixels generate^ 

-6- 



ratio, 
by the 



first interpolation processing and those generated by the second 
interpolation processing that are mixed when being interpolated/ 
but also can set a value of "0" or "1" which represents 0:100% 
or 100%:0 naturally. 

By applying the present invention as explained above, 
the pixels interpolated separately in two modes of interpolation 
processing are blended, based on an evaluation function that 
depends on reference pixel data, and therefore, it is Feasible 
to prevent an error in selecting an interpolation method, based 
on the appraised attribute of the image for which interpolation 
is executed* 



Hereupon, the first interpolation processing f 
defined as the ability to execute interpolation p 
without decreasing the degree of tone value difference 
the existing pixels, corresponds to an interpolation 
wherein what is called an edge can be kept intact or hi 
without being shaded. The second interpolation pr 
function, defined as the ability to execute inter* 
processing without affecting the gradation of tones of 
corresponds to an interpolation pror.pss whpr:ein-subtle 
of tone values can be reproduced with the tone values ths 
differ among the pixels not being made uniform. When 
function of determining a blending ratio refers to a p 

nf pi vp Is around a pixol of target o£ interpolati oil , iL 
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how the tone values of the reference pixels are distributed in 
a range, based on which it appraises the attribute of the image, 
such as "like a natural picture" or "like an illustration, " Thus, 
it can be said that the reference pixel data reflects the 
dLLribute of the image tor which interpolation is executed. 
According to the attribute of the image for which interpolation 
is executed, a higher percentage nf ther— the - above first 
interpolation processing or second interpolation processing 
which is suitable for that image can be set when a blending ratio 
is determined. 

There are types of interpolation processing methods as 
mentioned above. Even if the above two modes of interpolation 
processing are executed, it is not necessary to restrict the 
application range to two types of interpolation processing to 
generate pixels to be blended* As an example of constitution 
in view hereof, the invention can be constituted in another aspect 
such that the above first i nt^rpnl ati nn_ prone ss.i ng function and 

second interpolation processing function can select 
interpolation processing to be executed out of a plurality of 
types of interpolation processing. That is, there are a 
plurality of types of interpolation to be executed by the first 
interpolation processing function to avoid decreasing the degree 
of tone value difference between the existing pixels. Similarly, 
there are a plurality of types of interpolation to be qxecuted 
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by the second interpolation processing function to avoid 
affecting the gradation of the tones of the image. From among 
them, by selecting an interpolation type suitable for the image 
for which interpolation is executed or selecting the one that 
can be used, interpolation processing that is more suit able for 
the category of the image can be performed. 

By applying the present invention in this way, the range 
of i ntArpoIation proccccing options is e-K.Ltiiit.ied and 
interpolation that is more proper processing can be performed. 

As a concrete example of this constitution, the invention 
can be constituted in another aspect such that the above first 
interpolation processing function is able to execute pattern 
matching interpolation which is performed, according to a 
predetermined rule, when a given pattern exists in the reference 
pixels, and interpolation by the nearest method. Because a given 
pattern is often detected, based on the degree of tone value 
difference between the existing pixels, pattern Hatching 
interpolation is applied in such cases. For a pattern -hat may 
be detected, an interpolation rule is predetermined so that 
interpolation will be executed to retain or highlight the tone 



value difference. In this way, image interpolation 



executed without decreasing the degree of tone value difference - 



On the other hand, because the nearest method 



•puei- cu lte "xnverpo'xaLea trie value of a source image pixel or 
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can be 



gxves a 



pixels _D^atf»st..f.n _it-_, . the degree -of -tone - value- d±f f c!~~~ ~ 
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t method 



retained. Thus, both the pattern matching and neares 
belongs to the mode of the first interpolation processing 
function and either can be selected, according to circumstances. 
In fact, if a given pattern does not exist in the reference pixels, 
the above pattern matching interpolation cannot be executed; in 
this case, the nearest method will be selected and executed. 

By applying the present invention in this way, 
interpolation can easily be performed without decreasing the 
degree of tone value difference between the existing pixels. 

Furthermore, as a concrete example of the second 
interpolation processing function, the invention is constituted 
in another aspect such that the above second interpolation 
processing function is enable to execute interpolation by the 
cubic method. In the interpolation by the cubic method, 
generally, 16 pixels around a pixel of target of interpolation 
are used as reference pixels and the method generates data of 
pixels of interpolations in which the tone values of the reference 
pixels are reflected, according to the degree of influence of 

the rp .fffrpnria pixels on the target pixel depending cn their 

distance to that pixel. By the cubic method, thus, subtle tone 
gradation of the reference pixels can be reflected to th<3 pixels 
of interpolations* The cubic method belongs to the mods of the 
second interpolation processing function. By blending the 
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abil 



pixels interpolated by the cubic method with those int 
by the first mode of interpolation, interpolation sui 
a multi-tone natural image can be supported. 

By applying the present invention in th 
interpolation can easily bt; performed without afie 
gradation of the tones of the image. 

As the one essential to blending pixels inte 
separately in two modes of interpolation processing to t 
for which .ijot£rpoJLat.lo.r> .is. pyprnted, the above- first •- 
of determining a blending ratio is defined as the 
riftf ^rin-i n#» a blinding ratio -between both, modes. The 

determining thereof is varied. As an example of cons 
in view hereof f the invention may be cons tri tut ed~in anothe 
such that the above first function of determining a blend 
determines a blending ratio by using an evaluation functji 
depends on the above reference pixels data. This e 
function is a function dependent on the reference pi 
and the reference pixels reflect the attribute of the i 
which interpolation is executed as described above 
using the evaluation function dependent on the refere 
data, a blending ratio between the pixels interpolate 
first interpolation pronftssirg *rirt the pix«ls interpo 
the second interpolation processing can easily be det 
By applying the present invention in this way, a 
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that the 



Lbute of 



ratio can easily be calculated. . ... 

As an example of concrete method of determining a 
blending ratio, Lhe invention may be constituted such 

above first f um~t" i nn nf Hpformining at blonding r-dfci© determines 

a blending ratio, based on the tone values of the above reference 
pixels. The tone values of the reference pixels reflect the 
attribute of the image for which interpolation is executed and 
by using a function dependent on the tone values, a blending ratio 
can be determined, according to the attribute of the image for 
which interpolation is executed. 

By applying the present invention in this way, a blending 
ratio can easily be determined, according to the attr: 
the image for which interpolation is executed. 

Furthermore, as an example of this constitution, the 
invention may be constituted in another aspect such that the above 
first function of determining a blending ratio detejrmines a 
blending ratio, based on the number of discrete ton^ values 
appearing in the above reference pixels. Because a 
illustration image is normally depicted in a small nikmber of 
colors, some of the reference pixels are considered having a 
©ommon tone value and only d small number of pixels have their 
discrete tone value. By contrast, because a natural picture is 
normally depicted in a great number of colors, most of the 
reference pixels have their discrete tone value. In this way, 
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logo or 



the number of discrete tone values appearing in the reference 
pixels reflects the attribute of the image for which 
interpolation is executed and a blending ratio can be detarmined, 
according to the attribute of the image. As a concrete example 
of such reflection, after counting the number of discrete tone 
values cippearing in the reference pixels, the smaller this count, 
the higher percentage of the above first interpolation 
processing will be set when a blending ratio is determined. 

By applying the present invention in this way, a blending 
ra-cio can be determined, depending on whether the image is like 
a natural picture or a non-natural picture. 

Furthermore, as an example of such constitution, the 
invention may be constituted in another aspect such that the above 
first function of determining a blending ratio gives a 3>lending 
ratio on the condition that when the above number of discrete 
tone values appearing in the reference pixels is less? than a 
predetermined threshold, only the above first interpolation 
processing should be used. As described above, the greater the 
number of discrete tone values appearing r the image becomes 
colorful; inversely, the smaller the number of discreste tone 
values appearing, the image becomes monotonous. If th<> number 
of discrete tone values appearing in the reference pixels is less 
than a predetermined threshold, the image is regarded as 
belonging to illustrations and logos and the first function of 
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determining a blending ratio gives a blending ratio so that only 

the above first interpolation processing will be active, 

i 

Consequently, this can prevent: blending of pixels interpolated 
by the above cubic method or the like and the pixels of an 
illustration or logo image; increase of arithmetic processing 
time in vain; and shading the contours- 

By applying the present invention in this way, a blending 
—ratio can be determined/ depending on whether tire image: is like 
a natural picture or a noti-natural picture. 

Furthermore, an *n ample o-f ^othe^constitution , the 
invention may be constituted in another aspect such that t he above 
first function of determining a blending ratio increases the 
percentage of the above first interpolation processing in direct 
proportion to the increase of the width of the range within which 
the tone values of the above reference pixels fall when 
determining a blending ratio. Hereupon, the width of thie range 
of the tone values is difference between the maximum tone value 
and the minimum tone value. When what is called an edge is formed 
in the reference pixels, this width of the range of the tone values 
becomes larger. Then, the larger the width of the range of the 
tone values, the greater percentage of the above first 
interpolation processing will be set when a blending ratio is 
determined. In this way, when more edge-like visualization 
exists in the reference pixels, image interpolation is executed 
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not to decrease the edge. Specifically, this can be 



by using the value of the above evaluation function that 



realized 



monotonously increases in direct proportion to the inc 



the- width of the ta«e-valuc range. Bd^eU on this value, trie 
percentage of the first interpolation processing is set when a 
blending ratio is determined. 

By applying the present invention in this way, vjhen more 
edge-like visualization exists in the reference pixels, image 
interpolation can be performed not to decrease the edge. 

- Furthermore, as a concrete example of the above tone 
values, the invention may be constituted in another aspect such 
that the above tone values of the reference pixels are luminance 
values. When an image is represented in multi-tone dot matrix 
pi v<=> 1 q _ normally, a. pixel has tone value data for each color and 
a value of luminance of the pixel is determined from :he tone 
value data for each color. Thus, the characteristics of a pixel 
can be grasped exactly by using its luminance value and can be 
reflected in calculating a blending ratio. 

By applying the present invention in this way, the 
characteristics of a pixel can be reflected exactly in the 
evaluation function . 

Then, such image interpolation program can be applied 
as part of a print control program that makes a computer perform 
interpolation processing as well as print control processing j 



rease of 
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in order to obtain image date input and send interplolation- 
processed image data to a printer where a print is obtained from 
such image data. 

Fr>r this purpose, the present invent ioxi mcty 
constituted in another aspect to make the computer, in addition 
to the above functions, perform: a function of print quality 
-parameters acquiaitioxL that acquires print quality parameters, 



according to which the above printer prints an image 



from the 



above image data; a second function of determining a blending 



ratio that determines a blending ratio between the; 



interpolated by the first interpolation processing a:id those 
interpolated by the second interpolation processing, based on 
the print quality parameters; and a function of print control 
processing that executes print control processing, based on the 
data of pixel interpolations blended at the above blending ratio. 

In the invention constituted as above, an initial step 
for making a computer perform interpolation processing as well 
as print control processing in order to obtain the input (of image 
data of an image represented in multi-tone dot matrix pixels and 



pixels 



send interpolation-processed image data to the printer 
print is obtained from the image data is that the print 
parameters acquisition function acquires print 
parameters, according to which the above printer prints 



from the above image data* The second function of determining 
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where a 
quality 
quality 
an image 



a blending ratio determines a blending ratio betwejen pixel 
interpolations generated by the first interpolation processing 

and those generated by the second interpolation processing/ 

i 

based on the print quality parameters acquired. The function 
of image data blending blends the image data of interpolations 
generated by the first interpolation processing functioh and the 
corresponding data generated by the second interpolation 
processing function at the blending ratio determined by the 
second function of determining a blending ratio. T^en, the 
function of print control processing executes print) control 

i 
i 

processing, based on the thus blended data. Thijs, the 

present invention enables two modes of interpolation processing 
by means of the first interpolation processing f unction and the 
second interpolation processing function . The pixels of image 
data interpolated by both functions are blended at a ratio that 
is determined, ha.^Rri r>n 1-he .print quality rotting. In 
consequence, print results can be obtained from the data 
processed by interpolation that is effective for each parameter 
setting of print quality. Moreover, there is no possibility that 
incorrect judgment is made as to whether logos or natural pictures 
to which the image for which interpolation is executed belongs, 
causing the execution of only interpolation processing that is 
unsuitable for the interpolation of that image; i.e., i:here is 
no possibility that the printer makes poor print results due to 
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a decisive error in selecting an interpolation method. 

Reasonably, also in this embodiment: mode, ths second 
function of determining a blending ratio not only sets a ratio 
between pixels generated by the first interpolation processing 
and those generated by the second interpolation processing that 
are mixed when being interpolated, but also can set a value of 
"0" or n l w which represents 0:100% or 100% :0 

By applying the present invention in this way,- the pixels 
interpolated separately in two modes of interpolation processing 
are blended, based on an evaluation function that depends on 
reference pixel data, and therefore, it is feasible to prevent 
an error in selecting an interpolation method, based on the 
appraised attribute of the image for which interpolation is 
executed 



The above second function of determining a blendijng 
determines a blending ratio, based on print quality 
There is a causal relationship between print'quality set 
interpolation y j. u^«aaiiiy result; e.g., wirh low prxnt 
setting, even if interpolation processing is executed 
affecting subtle tone gradation, its effect is not ref 
the print result ♦ By determining a blending ratio, 
print quality setting, a higher percentage of either 
first interpolation processing or second interjk 
. _pr_OCPR..s i.ng. .which - is suitabi-c -Gan -bo cct when-a blendin 
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is determined, according to the effect of the inteipolation 
processing on the print result. As a concrete example, it is 
conceivable to use an evaluation function that depends on print 
quality setting . Based on the value of such evaluation function, 
a blending ratio can easily be determined. 

By applying the present invention in this way, a blending 
ratio can easily be calculated, based on the value of tjhe above 
evaluation function. 

As an example of constitution for setting i higher 
percentage of either interpolation processing whose e 
visually noticeable, based on print quality setting, in this way, 
the invention is constituted in another aspect such that the above 
second function of determining a blending ratio sets a higher 
percentage of the above second interpolation processing when 
determining a blending ratio when the above print quality 



pa] 



rameters acquired indicate higher print quality. Because the 



pixels 



above second interpolation processing interpolates 
without affecting the tone gradation, in order. to obtain print 
results that subtle tone gradation reproduced in the 
interpolated pixels will also be reproduced thercorL print 
quality must be high; otherwise, this processing is meaningless, 
or ineffective. By setting a higher percentage of tho second 
interpolation processing when determining a blending ra.io when 
higher print quality is set, the pixels separately interpolated 
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in both modes can be blended, according to the print 
setting . 

By applying the present invention in this way f 
the pixels separately interpolated in both modes, acco 
the print quality setting, can easily be performed. 

Although there are a variety of possible manners 
the second function of determining a blending ratio is 
to operate in this way, as an example of such constitut 
invention is constituted in another aspect such that t|he 
second function of determining a blending ratio inhiblit 
the above first interpolation processing from being actlive 
the above print quality parameters acquired indicate hi 
quality • The above first interpolation processing 4io« 
decusdiie the degree or tone value difference between the 
but tends to affect the above tone gradation* If only t[he 
interpolation processing is active when high quality 
is performed, there is a possibility of printing 
interpolation data that does not reproduce the tone g 
of the source image at all. Thus, a blending ratio is 
to inhibit only the first interpolation processing f 
active when high quality printing is performed f 
eliminating 

By applying the present invention in this way, there is 
no possibility of a decisive- error occurring in selecting an 
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interpolation method relating to print results. 

Hereupon f types of parameters determine print quality 
setting and the above-mentioned function of print quality 
parameters acquisition acquires these parameters, thereby the 

print quality setting can be obtained. For example, when a 

; 

printing paper parameter is acquired f print quality setting 
specified by this parameter is obtained. There are a variety 
of printing paper types, such as glossy paper, plain paper, etc. 
Even if printing is performed from same image data under same 
conditions of parameters except the printing paper, t ne print 
results on paper of different types are considerably different- 
The above function of print quality parameters acquisition 
acquires the printing paper parameter and the above; second 
function of determining a blending ratio determines a blending 
ratio, based on this paper parameter setting. Thereby, the 
pixels separately interpolated in both modes can be plended, 
according to the print quality settincr. 

By applyina the present invention in this way, lh"f finding- 
the pixels separately interpolated in both modes, according to 
the print quality setting, can easily be performed. 

Another example of print quality parameter is priht speed. 
Recent printers may be provided with high-speed print mode and 
low-speed print mode. The former mode prioritizes prin: speed, 
but print image quality somewhat decreases.- The later mode 
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parameter 



ng 



prioritizes high image quality, but print speed is lows 
a print speed parameter that discriminates between higli 
speed is acquired, print quality setting according 
parameter is obtained- The above function of print 
parameters acquisition acquires the print speed 
the above second function of determining a blendi 
determines a blending ratio, based on this print speed p 
octting. Thereby, the pixels st*y dLcL tely ±11 terpolated 
mode s - can -be blended, according to the print quail L y 

By applying the present invention in this way, 
the pixels separately interpolated in both modes , acco 
the print speed setting, can easily be performed. 

Another example of print quality parameter is re£ 
of print. The precision of prints made by printers is v 
as mentioned above, and pixels are interpolated betweer 
source image data before normal printing is performed, 
printing is performed on same area from source image dat 
amount, print results are considerably different by di 
of resolution (dpi) of print. When a print resolution 
is acquired, print quality setting specified by this 
is obtained. The above function of print quality 
acquisition acquires the print resolution parameter 
above second function of determining a blending ratio de 
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setting. Thereby, the pixels separately interpolate^ in both 
modes can be blended, according to the print quality setting, 

By applying the present invention in this way, blending 
the piKclo separately interpolated iii buLh modes, acccrding to 
the print resolution setting, can easily be performed 

Another example of print quality parameter is 
There are pigment ink and dye ink for use on printers 
its property, the pigment ink does not easily blur as 
with dye. Edges of the image printed on paper with pi 
are sharper contrast than edges of the image printed 
ink. In short , different ink types make different quali 
Thus, the above function of print quality parameters a 
acquires the ink type parameter and the above second 
of determining a blending ratio sets a lower percentagje 
above first interpolation processing when determining a 
ratie if this parameter specifies pigment ink to 
Thereby, the pixels separately interpolated in both 
be blended, according to the print quality setting- 
By applying the present invention in this way, 
the pixels separately interpolated in both modes, a 
the ink type setting, can easily be performed. 

The recording medium of the present invention, mentioned 
hereinbefore, of course, may be a magnetic recording medium, a 
magneto-optic recording medium, or any other recording medium 
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iccord 



jjnk type. 
Due to 
ompared 
girnent ink 
tfith dye 
prints . 
isition 
function 
of the 
blending 
te used, 
mpdes can 

lending 
ing to 



which will be developed in future, ail of which can be considered 
applicable to the present invention in all the siime way. 
Duplicates of such medium including' primary and secondary 
duplicate products and others are considered equivalent to the 

above medium without doubt. If a communication line in used as 
a way of distributing the program of the present invention, which 
is different from the above medium, the communication line is 
regarded as a distribution medium of the program so that the 
present invention will be used. 

Furthermore, even if part of the present invention is 
implemented by ooTLwaxe and the remaining part is implemented 

by hardware, thic doco not differ at all from tbw&w fuiLh 
herein in the concept of the invention. The present iivention 
may be implemented in such a manner that part of the invention 
has been recorded into a recording medium in advance and will 
be read appropriately, as required. 

The interpolation processing program that can execute 
two modes of interpolation processing and blends the pixels 
separately interpolated in both modes, based on the evaluation 
function dependent on reference pixel data is considered as 
follows. Processing is carried out under the control of this 
program and its procedure is based on the invention without doubt, 
thus it is easily understandable that realizing the invention 
as the method is also applicable. The aspect of the invention 
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defined in claims 12 to 22 essentially takes the same e 
ut:^uj:lbtid above. Tliat is, the invention is not ne 



ces 



computer is 



embodied as a concrete medium and its implementation as t&e 
is correspondingly effective without doubt* 

Such program is implemented on a concrete computer • In 
this respect, it is easily understandable that embodying the 
present invention as an apparatus comprising such 
also applicable. The aspect of the invention defined 
23 to 33 essentially takes the same effect as describejd 
Of course, such apparatus may operate singly to carry 
present invention or may be assembled into another equi 
carry out the present invention in conjunction with 
method. Not limited to those set forth herein, the c 
the invention comprehends a varie£y~of modes of its 
and modifications thereto are possible without depart 



ffect as 
sariiy 
method 



claims 
above . 
out the 
to 
another 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing an image data 
interpolation apparatus as a preferred embodiment of the present 
invention . 

Fig. 2 is a block diagram showing the hardware embodiment 
of the above image data interpolation apparatus. 
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Fig. 3 is a schematic view of another example of 
application of the image data interpolation apparatus of the 
present invention • 

Fia. 4 i s A Rr.hpmnfi r viou ^ mother example o£ 

application of the image data interpolation apparatu 
present invention . 



s of the 



£l g. S is a achematic view aaulhci tsxc.mple of 



XT' » -j 



3 of the 



application of the image data interpolation apparatu 

present invention . 

Fig. 6 is a schematic view of another exemple of 

application of the image data interpolation apparatus of the 

present invention . 

Fig. 7 is a flowchart illustrating the process regarding 

resolution conversion that a printer driver executes, 

Fig. 8 is a flowchart of first interpolation processing- 
Fig. 9 is a graphical representation of a histogram of 

Luminance values , 

Fig- 10 is a graphical representation, of application 

examples of evaluation function F (y) . 

Fig. 11 is an illustration giving a luminance 
example of 3 x 3 pixels. 

Fig, 12 is an illustration showing a zone comp: 

x 5 reference pixels. 

Fig. 13 is an illustration giving edge pattern examples. 
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pattern 



::ising 5 



Fig. 14 is a conceptual representation of the 

method. 

Fig. 15 is an illustration wherein data of the gr; 

is copied to their nearest points to be interpolate 

nearest method- 
Fig. 16 is a schematic illustration showing 

of the pixels before interpolation by the nearest me 
Fig. 17 is a schematic illustration showing t 

of the pixels after interpolation by the nearest me 
Fig. 18 is a conceptual representation of t 

method . 



nearest 

d points 
L by the 

the state 
thod. 
ne state 
thod. 
le cubic 



Fig. 19 is a graphical representation showing how pixel 
data changes when the cubic method and its variant are applied. 

Fig. 20 is a tabulation of pixel data obtained a$ a cubic 
method application example. 

Fig. 21 is a tabulation of pixel data obtained as an 
M-cubic method application example. 

Fig. 22 is an illustration showing how the pixels, 
separately interpolated in two modes, are blended and Supplied 
to image data. 

Fig. 23 is a schematic block diagram of a color printer 
of ink jet type. 

Fig. 24 is a schematic illustration of a print hjead unit 
of the above color printer. 
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Fig- 25 is a schematic illustration showing a mechanism 
of jetting color ink out of the above print head uni':. 

Fig. 26 is a flowchart of image data flow in the printing 

system. 

Fig. 27 is a schematic illustration showing a bubble jet 
mechanism of jetting color ink out of the print head T 

Fig- 28 is a schematic illustration of an 
electrophotographic printer. 

Fig. 2 9 is a block diagram showing the outline 
configuration of the printing system, 

Fig. 30 is a flowchart il] n?str«t*ing tbp.procees regarding 

print processing that a printer driver executes 

Fig. 31 is an illustration showing a window for printing 
operation. 

Fig. 32 is an illustration showing a window for printer 
setup operation. 

Fig. 33 is a graphical representation of application 
examples of evaluation function F (y) . 

Fig. 34 is a schematic diagram giving an overvie[w of the 
first preferred embodiment of Llits jL>j_es?enL Invention. 

Fig. 35 is a schematic diagram giving an overview of a 
second preferred embodiment of the present invention. 

Fig, 36 is a flowchart illustrating decisions to fce made, 
subject to the conditions for an edge with an angle of 45 cjegrees 
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Fig. 37 is a flowchart illustrating decisions to; 
► ubje^L lu the conditions tor an edge with an angle of 30 
Fig. 38 is an illustration showing source pi 



be made, 
degrees . 
xels and 



pixels of interpolations to be generated from the target source 
pixel, where it is assumed that a horizontal edge has been found 
and the magnifying rate of two times applies. 

Fig- 39 is an illustration showing source pixels and 
pixels of interpolations to be generated from the target source 
pixel, where it is assumed that an angular edge has been found 
and the magnifying rate of two times applies. 

Fig. 4 0 is an illustration showing source pikels and 
pixels of interpolations to be generated from the target source 
pixel, where it is assumed that an edge with an angle of 45 
has been found and the magnifying rate of two times c 

Fig. 41 is a flowchart illustrating decisions to 
subject to the conditions for an edge with an angle of 45 degrees 

Fig. 42 is an illustration showing source pixels and 
pixels of interpolations to be generated from the targe 
pixel, where it io assumed that an cdyc with an dxjgle of 30 
has been found and the magnifying rate of two times a 

Fig. 43 is a flowchart illustrating decisions to oe made, 
subject to the conditions for an edge with an angle of 30 degrees 



degrees 
pplies ♦ 
be made, 



t source 
degrees 
pplies . 



DESCRIPTION OF THE PREFERRED EMBODIMENTS 
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Preferred embodiments of the present invention will now 



primary 



be described, based on the drawings. 

Fig. 1 is a block diagram showing the 
configuration of an image data interpolation apparatus as a 
preferred embutiimerrt of ih^presSnt invention. 

When digital processing is assumed, an image is 
represented in dot matrix pixels and image data comprises all 
pixel data of the image. In the mode of image processing in units 
of pi xp 1 s , image enlargement and reduction are performed in units 
of pixels. The present image data interpolation apparatus 
performs such image enlargement processing in units of 
An image data acquisition unit Cll acquires such image 
a first interpolation processing unit C12 and a 



pixels . 
data and 
second 



interpolation processing unit C13 perform interpolation 
processing by which the number of pixels constituting the image 
data multiplies. The first interpolation processing unit C12 
is able to execute the pattern matching method and the 
method as interpolation processing. The second interpolation 
processing unit C13 is able to execute the cubic method as 

interpolation proccd^irig . 

at 



A first unit of determining a blending r 
appraises the attribute of the image, based on referenc^ 
around a pixel for which interpolation is just now e 
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io C14 
pixels 
xeiuted in 



the image data acquired by the image data acquisition unit Cll, 
and determines a blending ratio between the pixels interpolated 
bv the first i nf ^rnAl ?t ion procsseincp-'Unit CI 2 and those 
interpolated by the second interpolation processing unit C13, 
based on the above attribute. Once the first unit of determining 
a blending ratio C14 have determined a blending ratio, an image 
data blending unit CIS blends the data of the pixels interpolated 
by the first interpolation processing unit C12 and the data of 
the pixels interpolated by the second interpolation processing 
unit C13 at that blending ratio. Then, an image data output unit 
CI 6 outputs th.^ pi v<=> i <3 nf interpolations data bl-sndcd by t he image 
data blending unit CIS. 

In the present embodiment of the invention, as an example 
of the hardware embodiment of the above image data interpolation 
apparatus, a computer system 10 is applied. 

Fig. 2 is a block diagram showing this computet system 

10. 

This computer system 10 is equipped with a scanner 11a, 
a digital still camera lib, and a video camera 11c as image input 
devices connected to a computer main unit 12, These input 
devices are able to generate image data represented dc: matrix 
pixels of an image and output such data to the computer main unit 
12. Such image data enables image representation in about 
16, 700 , 000 colors by varying 256 tones of the three primary colors 
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of R, G, and B. . I 

To the computer main unit 12, a floppy disk dxive 13a, 
a hard disk 13b, and a CD-ROM drive 13c are connected as external 
auxiliary storage. System-related main programs are stored in 
the hard disk 13b and other programs, if necessary, can be read 
from a floppy disk 13al and a CD-ROM 13cl. 

As a communication device for connecting the computer 
to an external network, a modem 14a is connected to the computer 
main unit 12 to enable the computer to connect to the external 
network via a public communication line, so that software and 
data can be downloaded into the computer across the commuiicat ion 
line. Although, in this example, the modem 14a enables access 
to the external over a telephone circuit r a LAN adapter may be 
attached to the computer so that access to a network can be made 
via the LAN adapter. To the computer main unit 12, moreover, 
a keyboard 14a and a mouse 15b for operating the computer are 
connected. 

Furthprmnrp, f ho rnmni; ter is equipped v/it.h a dioplay 17a 
and a color printer 17b as image output devices- The display 
17a has a display area of horizontal 800 pixels by vertical 600 
pixels and can display each pixel in the above-mentionfed color 
range of 16,700,000 colors. This resolution is, of courlse, only 
an example, and the resolution can be modified appropriately; 
e.g., 640 x 480 pixels, 1024 x 768 pixels, and so on, 
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The color printer 17b is an ink jet printer and can print 
an image by printing the dots of the mage on printing paper which 
is an image recording medium, using inks of four colors, C, M 
Y, and K. In addition to normal density of 360 x 360 dpi of an 
image printed by the printer, the printer is capable 
density printing with density of 720 x 720 dpi, and is 
with two options of tone representation; either color ink print 
or colorless. 



of hiah 
provided 



Meanwhile, inside the computer main unit 17 



programs run to input an image to the computer via an/ of the 
above image input devices while outputting an image t 
output device. Hnriong such programs, an operating sys 
12a runs as a basic program. In the operating program 12a, a 



display driver (DSP DRV) 12bc that controls the displa 
make image display and a printer driver (PRT DRV) 
controls the printer 17b to make image print output are as 
These drivers 12b and 12c depend on the model of the dis 



and the model of the color printer 17b and can be added to or 



, given 



o either 
-em (OS) 



.y 17a to 
2c that 
iembled. 
play 17a 



display 
r either 



removed from the operating system 12a, according to the 
model and the printer model selected for use. Moreover 
driver can implement additional function beyond the standard 
processing scope,, dependent on the model selected for uso. That 
is, even if any driver is assembled into the operating system 
12a, a common processing system is maintained by the standard 

-33- 



operating system 12a, while a variety of additional processing 
nan *hf» imp! pnipnt H r according to ths d r i vo r ^ -w i t hi n -a pcrcniooiblc 

range . 

Inside the computer main unit 12, of course, essential 
components are installed for running such programs; CPU 12e, RAM 
12 f, E0M12g, and I/O interface— 12h . The CPU 12e that performs 
arithmetic operation appropriately executes the basic program 
written into the ROM 12g, while using the RAM 12f as temporary 
working area, setting save area or program area, and controls 
the external devices connected to the computer via the I/O 
interface 12h as well as the internal components. 

Application 12d is run on the operating system 12a as 
the basic program* The application 12d executes a wide range 
of processing: it watches for the operation of a keyboard 15a 
and a mouse 15b which are the operation devices; when such device 
is operated,- it appropriately controls kinds of external devices 
and executes the appropriate operation; and it displays the 
result of operation on the display 17a or sends the result to 
the color printer 17b. 

In the above computer system 10, image data is acquired 
by the scanner 11a which is an image input device. After 
processed by the application 12d, according to predetermined 
image processing, the image data can be output to either image 
output device; it may be displayed on the display 17a or sent 
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to the color printer 17b from which it is printed* Her^, simply 

i 

take notice of the correspondence between the pixels of the source 
image and the pixels of the printed image. If the density of 
the pixels of the image printed by the color printer 17ii matches 
the density of the pixels of the image scanned by the scanner 

i 
i 

11a, the scanned source image and the printed image ar^ of same 

i 

size ♦ If the former density is different from the latter density, 
the size of the printed image is different from the si2e of the 
scanned image. Most models of the scanner 11a are capable of 
scanning images with the density of pixels corresponding or 
approximating to that of the color printer 17 b. However f in 
many cases, the density of pixels of images printed by the color 
printer 17b which is designed to enhance the density of pixels 
for high quality image printing is generally higher *:han the 
density of pixels provided by general image input <pevices. 
Especially, as compared with the density of pixels of pn image 
displayed on the display 17a, the density of pixels of that image 
printed by the color printer is significantly hiyhei . p?hen the 
data of an image displayed on the display 17a is sent to the 
printer and the image is printed in the corresponding number of 
pixels , there is a possibility of th« Rx-hr-^mpn y reduced image 
being printed. 

By rftfl«!on hereof, resolution conversion is executed to 
eliminate the difference in the density of pixels between 
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practically used devices, while the operating system 12a sets 
standard density of pixels. If the resolution of the display 
17a is, for example, 72 dpi, and if the operating system 12 sets 
a standard resolution of 360 dpi, the display driver 12b executes 
resolution conversion from 72 dpi to 360 dpi. If the resolution 



of the color printer is 720 dpi, and if the same 
resolution applies, the printer driver 12c executes re 
conversion. 



standard 
solution 



The resolution conversion is a processing by w 
number of pixels constituting the image data multiplies 
corresponds to interpolation processing. The above 



hich the 
and thus 
display 



driver 12b and printer driver 12c execute the interpolation 



processing as one of their functions. Hereupon, the 
driver 12 b and printer driver 12c are able to 



interpolation as the above-described first interpolation 



processing unit C12 and second interpolation processing 
do, and furthermore execute processing as the first 



display 
execute 



unit CI 3 
unit of 



determining a blending ratio C14, the image data blending unit 



?ers are 
<s first 



CI 5, and the image data output unit C16 do. These dri 
designed to blend the pixels interpolated by th 
interpolation processing and those interpolated by th^ second 
interpolation processing at a ratio, according to the attribute 
of the image of input. 

These display driver 12b and printer driver 
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12c are 



scored in the hard disk 13b and put into operation after read 

i 

Lo the computer main unit 12 when the computer is booted up. 
Hither driver is installed as follows: set a medium such as a 



CD-ROM 13cl or a floppy disk 13al whereon these drivers £ 



the 



ra 



ipparat 



recorded in the appropriate drive and install it from tb 
into the hard disk. Thus, such medium corresponds to 
whereon the image data interpolation program has been r 
Although the image data interpolation appa 
embodied as the computer system 10 in the present 
the invention; s uuli ^uau^uLtrji iysLem is not necessar 
Instead, a system may be used that can implement the 
functions required for image data interpolation process! 
example, a system which is shown in Fig. 3 is feasibl 
a chip equivalent to the image data interpolation a 
executing interpolation processing is assembled into a 
still camera llbl and interpol at* i nn-nrnr.pgse/i linage dat 
chip is input to a display 17al or a color printer 17bl 
an interpolation-processed image is displayed or 
Moreover, a color printer 17b2 that prints an image aft 
data is input thereto without the intervention of a 
system, as is shown in Fig. 4, can be configured to i 
the interpolation, according to the present invention, 
it will automatically execute resolution conversion i 
data input through a scanner lla2, a digital still came 
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e medium 
medium 
scorded ♦ 
tus is 
of 



ave been 



embodiment 
iHrxpauired. 
similar 
ng. For 
'5 r where 
us for 
digital 
a by the 
so that 
printed, 
ar image 
computer 
implement 
so that 
f image 
fca llb2. 



ux- ct modem I4a2 ana print trie image. 

i 

In addition, the prevent invention is, of course, 
applicable to types of equipment for image data processing, such 
as color facsimile equipment 18a , which is shown in Fig. 5, and 
color copy equipment 18b which is shown in Fig. 6. 

Fig. 7 is a flowchart illustrating the software operation 
flow regarding the resolution conversion that the above 
driver 12c executes. In Fig. 7, source image data is 
in step S102. During process sequence in which an 
scanned by the scanner 11a under the control of the app 



printer 
acquired 
Image is 
Lication 



12d, the linage data ic processed by predetermined image 



Led/ Lhe 



step is 
ion from 
ood that 



n rnraci ^ ^ nrj , ?.r.d printing -firom the image data is execu 
printer driver 12c acquires print data of predetermined 
resolution via the operating system 12a and this stage 
corresponds to the step S102 . The processing of this 
regarded as the step or function of image data acquisit 
the software point of view. However, it can be underst 
the description of all steps including this step of image data 
acquisition to be executed by the computer does not directly 
include the operation of the operating system 12a itself and 
hardware.- On the other hand, if this step is considered to be 
implemented as part of the organically integrated operation of 
• tho ha-rd^ro-inciudir^-the-CF'u, it %juxx*sfi*p*uii<35 to the action Ot 
the image data acquisition unit Cll. 
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In step 5104, a pixel in the read image data i 
a target of interpolation, the pixel data in a zone 
5x5 pixels around the target pixel is set. t.n bp reference 
and a histogram of the luminance values of the reference 
is created. In step S106, the number of discrete 1 
values appearing in the created histogram is counted and 
is made as to whether this count is less than 15, The 
the number of discrete luminance values, the greater wi;_ 
number of colors assigned to the reference pixels, 
fact, if the number of discrete luminance values appe 
the histogram is less than 15, the reference pixels are 
as tho pixels belonging to a non-natural picture, 
judgment io the above step 31CG is LhctL Llits nuiubex ul 
luminance values appearing is less than 15 , the blendi 
(hereinafter referred to as the rate) of interpolati 
above first interpolation processing to those by th 
interpolation processing is set to 1 in step 110- 

When the judgment in the step S106 is that 
of discrete luminance values appearing is not less than 
rate is determined by an evaluation function F in step SI 
evaluation fu-nction F, which will be detailed later/ is a 



s set as 
comprising 
pixels, 
pixels 



the 



of the width of the range within which the luminance vfc 
the above reference pixels fall, that is, the difference 
the maximum luminance value Ymax and the minimum luminanjce 



ammance 
udgment 
greater 
1 be the 
Ftom this 
string in 
regarded 
When the 
discrete 
ng ratio 
,on|s by the 
second 



03 



number 
15, the 
, This 
function 
lues of 
between 
value 



Ymin among the reference pixels . Thus, the sequence of 
S1G4, S106, S108, and S110 corresponds to the first 
function of determining a blending ratio. If these s 
considered to be implemented as part of the org 
integrated operation of the hardware including the CPU, 
defined as the action of the first unit of determining a : 



th 



e steps 
step or 
.eps are 
anically 
they are 
lending 



ratio C14. 

After the rate is determined in the step S108 or 
S110, judgment is made as to whether the rate is "0" in s 
When the rate is n 0, tt the first interpolation processir 
executed. When tho judgment in the step S112 is that 
is other than "0, " the first interpolation processing is 
in step S114. Thus f this step corresponds to the step or 
cf first interpolation processing-; — If— this step is co 
to be implemented as part of the organically integrated 
of the hardware including the CPU, it is defined as th 
of the first interpolation processing unit C12- 

Then, in step S116, judgement is made as to 
rate is "1." When the rate is "1," the second inte 
proccCfil'ng la not executed. When the judgment In the rs 

is that the rate is not "l, n the second interpolation 



tep 



wheth 



is executed in step S118. Thus, this step correspond^ 
step or function of second interpolation processing, 
step is considered to be implemented as part of the or 
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the step 
S112. 
g is not 

the rate 

executed 
unction 
:i3ider«d 

ration 
3 action 



ope 



roc 



er the 
lation 

tep £116 

ssing 
to the 
If this 
ically 



proce 



g;an 



CPU 



integrated operation of the hardware including the 
defined as the action of the second interpolation proces; 
C13. After the rate is determined in this way and t 
and/or second interpolation processing is executed, in s 
blending of pixel data of interpolations is performed/ a 
to the following equation, wherf* th& Kf*i- r*t-*» *ha!l be a 



, it is 
ing unit 
he first 
1:ep S120, 
ccording 
ssigned, 
ep S120. 



and then pixels of interpolations are generated in st 



Data to be blended = 

(First interpolation) x rate + (Second interpolation) 
x {1 - rate) 

... (1) 



Thus, this step corresponds to the step or funption of 
image data blending. If this step is considered to be 
implemented as part of the organically integrated operation of 
the hardware including the CPU, it is defined as the action of 
the image data blending unit C15* Upon the completion of the 
above sequence of generating data of interpolations to the target 
pixel, judgment is made as to whether blending of interpolated 
data has been completed for all target pixels in the input source 
image data in step S122- If not, the step S104 and subsequent 
steps are repeated until blending of interpolated data !ias been 
completed for all target pixels . Upon the completion of blending 
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of interpolated data for all target pixels, the 



24. For 
only by 



at -me »ns 



ssing of 



interpolation-processed image data is output in step SI 
the printer driver 12c, print data is not obtained 
resolution eonversion; color conversion and halftone processing 
_ a .r;p..f.nr.tHiar required. Thus, tho image data output ju 
transferring the data to the next stage and the proce 
this step corresponds to the step or function of image data output 
If- Lhis srep is considered to~~Toe implemented as par 1 : of the 
organically integrated operation of the hardware including the 
CPU. it is defined as the action of the image data outjput unit 
C16. 

Next, the detailed flow of the first interpolation 
processing in the step S114 in the above flowchart will be 
explained below. Fig. 8 is a flowchart illustrating the flow 
of the first interpolation processing. In step S202 irj Fig. 8, 

i 

from the pixel data in the zone comprising 5x5 pixels obtained 
in the above step S104, further, pixel data in a zone comprising 
3x3 pixels around the target pixel is extracted for 
matching- In step S204, from the thus extracted pixel 



pattern 
data r a 



two-valued pattern of the pixels is created, depending on the 
luminance values of the extracted pixels are greater than a 
predetermined threshold which will be described latei « 

In step S206, judgment is made as to whether the 

t 

two-valued pattern of the pixels created in the step S204 matches 
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a predetermined edgo pattern which has been prepared in advance, 
Here, the edge pattern is a two-valued pattern of the pixels, 
representing an edge with an angle, for example, 30°, 4o°, etc w 



formed in the above zone comprising 3x3 pixels. By 
whether there is a match between such edge pattern 



two-valued pattern of the pixels created in the above stjep S204, 
judgment is made as to whether the zone comprising 3x3 pixels 
is an edge. 

If the judgment in the step S206 is that both batterns 
match, pixels of interpolations are generated by a predetermined 
rule, according to the above edge pattern, in step S208- The 
interpolation processing to be applied when the patterns match 
is represented by the pattern matching method in the flow. If 
the judgment in the step S20 6 is that both patterns do not match, 
pixels of interpolations are generated by the nearest method in 
step S210, After the interpolation processing of thf target 
pixel is executed in this way, the result data of interpolation 
is stored into the RAM 12f in step S212 which is followed by the 
return to the above flow shown in Fig, 7 

Then, detailed processing for each step in tike above 
flowcharts will be explained below. In the present embodiment 
of the invention, judgment is made as to whether the source image 
acquired in the step S102 belongs to computer graphics (non- 
natural pictures) or photography (natural pictures) and the 
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j udging 
and the 



result of the judgment is reflected in setting a blending ratio 
between the first and second interpolations. To prevent 
incorrect selection of an interpolation method to be applied, 
based on the appraised attribute of the image for which 
interpolation is executed, it is, of course, possible to avoid 
fixing the above-mentioned rate to "l lf or "0," However, in the 
present embodiment, if the number of discrete luminance values 
appearing in the reference pixels is less than 15, the pixels 
are regarded as those belonging to a non-natural picture. This 
is because the inventor considers it more important to avoid the 
application of the second interpolation processing to non- 
natural pictures; otherwise, the second interpolation wculd make 
contours vague in a non-natural picture. 

For the above judgment, a histogram of luminance values, 
which is shown in Fig. 9, is used. In the step 104, the luminance 
values of the reference pixels in the zone comprising 5x5 pixels 
are obtained and a histogram is created to show how tha pixels 
are distributed in the range of their luminance valuss. The 
number of discrete luminance values appearing in the histogram, 
that is, how many luminance values appear for which th<2 number 
of distributed pixels is other than "0" is counted, based on which, 
the judgment i-n the step S10 G is made. Among 1, 670,000 colors, 
of course, a plurality of colors of same luminance exist on one 
imag^. When taking notice of comparison between natural and 
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non-natural pictures, quantitative comparison can be p 
whether the number of discrete colors or the number of 



er 



formed, 
discrete 



ma 



luminance values, based on which the comparison is 
addition to the luminance values, the number of discret 



appearing in the reference pixels may be counted, based on which 
judgment may be made as to whether the pixels belcjng to a 
non-natural picture . 

Tf the pixel data of the reference pixels [includes 

luminance as its component factor, distribution of th|e pixels 
can be obtained by using the luminance values of the pixels, 
However, even for some image data that does not include luminance 
values as its direct component values, the data would include 
component values indirectly representing luminance* {Thus, by 
converting color solid space in which luminance values are not 
direct component values to color solid space in which liaminance 
values are direct component values, luminance valued can be 
obtained. 



Color conversion between different coordinate 



of color solid apace is ihjl definitely formulated t>y a co 
formula • Mutual correspondence between component valu 
coordinates of different color space systems must be 
and a color conversion table that retains this corre 



created- By referring to this table, one-to-on 
conversion must be executed. Exactly speaking, thus, 
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conversion table containing 16,700,000 color elements must be 
prepared. As a result of considering the efficient use of 
storage resources, mapping of correspondence between different 
color components for all coordinate values is not feasible* 
Normally, trapping of correspondence between different color 
components at properly spaced grid points is prepared and 
arithmetic of interpolation is additionally applied. Kowever, 
because such arithmetic of interpolation involves a number of 

operations of multiplication and addition, a great apiount of 

t 

arithmetic processing is required. 

if a full color conversion tafcle as used, the amount of 

prcccscir.g is reduced, but the u^lo-le size ejtpcitiUs su eAtx^mely 
thaL is considered infeasible. If the table size is reduced to 
practically reasonable size, the amount of processing often 
increases so extremely that is considered infeasible. In view 
hereof, a simple method of luminance value calculation is taken 
in the present embodiment of the invention. Image data for which 
interpolation is executed is based on the color solid space of 
R f G, and B and each color component value represents brightness 
of color. By viewing the R, G, and B component values separately, 
the property of linear relation to luminance is found equally 
for all the components. Thus, it can be said that data reflects 
the luminance -value of a. piAtsl wilhuul ocuisidtf L lily Llie Idles oL 
the colors to be added even when we simply apply the following: 
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Y = (R + G + B} /3 
By using this formula, luminance values of pixels are calculated 
in the present embodiment of the invention. 

Of course, calculating luminance values of pixels is not 

nnl y bp?ed on this method- Ac is applied to tolcviei^nc, the 

following conversion formula by which the luminance of a pixel 
is obtained from the three primary colors of R, G, and B may be 
used : 

Y = 0.30R + 0.59G + 0.11B 
If this formula is used, luminance values of pixels can be 
obtained only by carrying out multiplication three times and 
addition two times. 

After the luminance values of the reference pikels are 
thus obtained, if 15 or more discrete luminance values for which 
the number of distributed pixels is other than "0" appears in 
the histogram, a blending ratio (of the first interpolation to 
the second interpolation} , namely, a rate is determined by a 
predetermined evaluation function F in the step S108. A solid 
line, which is shown in Fig* 10, is an example of such evaluation 



function F (y) , The evaluation function has a value 



tfhen "y' 



falls within the range that 0 £s y ^ 255 and varies in the range 
that 0 ^ r (y) 1. F (y> is 0 in Lhe range LhaL 0 ^ y ^ 64 
and i iu the ictuye LhaL 132 ^ y S 255. t* iy) linearly increases 
from 0 to 1 in the range that 64 Si y 192. Hereupon,, the width 
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of the range within which the luminance values falls, 
Ymin, " shown in Fig* l r is assigned to "y." Thus, the 
the value of this width, that is, the reference pi^< 
edge-like visualization due to mutual relation in lumi 
greater will be the rate. 

The evaluation function that sets the rate gre 
such ©dge-likcs vicuslisa-feion io not limited to the 
example shown in Fig. 10* As the evaluation funct 
function may be used that shows the characteristic : when t 
of the range of the luminance values is assumed varia 
function value increases monotonously as the value of 
increases. It is not necessary that the maximum val 
evaluation function be set to "1" and the minimum val 



th 



ue 



to "0. 11 The maximum value of the evaluation function may 



rpo 



at "0, 7" to prevent the execution of only the first inte 
processing. This function example is represented by 
line shown in Fig. 10. Alternatively, an evaluation 
whose value gradually changes over the range of luminanc 
of 0 to 255 may be used. 

In the histogram shown in Fig. 9, because ther 
luminance values for which the number of distributed p 
other than "0," after the affirmative judgment is mad^ 
step S106, a xalts la tfeLeuiLLned by Lht; evaluation f uncLi 
in Fig. 10 in the step S108. Then, the first inte 
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processing in the step S114 and the second interp 
processing in the step S11S are executed. Fig, 11A 
example of a luminance pattern of 3 x 3 pixels, extra 
step S202 in Fig. 8. In the step S204, a two-valued p 
the pixels, whose example is given in Fig, 11B, is creajt 

thft 1 iiTTi i nsriPP pjj-^arn shown, in Fig-, 11A . rirstly r fox 

pixels Pij, their luminance values Yij are calculated, a 
to the above luminance value calculation formula . 



A mftr! pr value between the maximum value Ymax 



olation 
gives an 
in the 
ern of 
ed from 

all the 

^cording 



and the 



ues 



minimum value Ymin of the thus obtained luminance val 
pixels is calculated and this means value is set 
above-mentioned threshold Yt . After the threshold is ca 



by comparing each pixels luminance value Yij with the t 
Yt, the pixels etre divided into those Having a lumina 

abnvR 1"hp t* hr*f»=*hrsl rf and those having a luminance valua 

threshold and the pattern of the pixels is conver 
two-valued pattern of the pixels. Of course, me 
selecting a threshold and creating a two-valued patte 
pixels are not limited to the above ways. A variety of 
thereof can be taken; e.g., a means luminance value o 
set as the threshold; if there are extremely low lumin 
that are less than "45," these values are ignored and the 
value is set at "45." 

Once a two-valued pattern of the pixels shown 
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in Fig. 



11B has been created, the judgment is made in the step 
to whether the two-valued pattern matches one of edge 
that have been prepared-in advance- Hereupon, various 
edge patterns can be used as the prepared ones* It is 
that the pattern of the pixels— shown in Fig. 11D match 
the prepared edge patterns. Because of matching with 
pattern, the pattern shown in Fig. 11B shows a charac 
that the difference between the luminance values of t 



positioned on the upper side in the j direction of th£ 
and those of the pixels positioned on the lower side 
direction of the figure tends to be great, but the 
difference in the horizontal direction on paper is little 
this pattern is regarded as a horizontally parallel e 
this edge pattern, pixel interpolation processing 
executed; according to a predetermined rule. 

Types of rules may be predetermined for types 
patterns. In principle, for given pixels in the ab 
comprising 3x3 pixels, a weighted average of the t 
of the pixels is calculated with each pixel being given 
of reciprocal ratio of its distance from its corre 
to be interpolated. Hereupon, we can conceive va 
regarding what policy should be applied for selecting 
the zone and calculatino the above weighted average on t 
to generate pixels of interpolations and how to reflect 
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and direction of the edge in generating thereof. In a sense that 
a predeteiniiueu vaiidLiuu thereof is set for a particular edge 
pattern, pixel interpolation processing is executed, according 
to a predetermined rule for an edge pattern. 

Although the above edge patterns are formed in the zone 
comprising 3x3 pixels, the above reference 5x5 pixels are 
also used to distinguish the above angle and directioh of the 
edge. A database of a variety of two-valued edge patte 
be prepared in advance. If these predetermined patt 
prepared by being formed in the zone comprising 5x5 
the number of the patterns becomes huge. In the 
embodiment of the invention, a practicable number 
patterns are prepared by being formed in the zone comp 
x 3 pixels and a two-valued pattern of the pixels in that zone 
is generated. After judgment is made as to whether -:he two- 
valued pattern generated matches one of the edge patterns, the 
zone comprising 5x5 pixels is -referred to for edge property 
reflection in generating pixels of interpolations . 

Rules of generating pixels of interpolations if the 
judgement is the match between the two-valued pattern of the 
pixels shown in Fig. 11B and the corresponding edge pattern will 
be explained below. Fig. 12A shows the zone comprising 5x5 
pixels which are the above reference pixels data, where each of 
the pixels is assigned one of A to Y alphabets for identifying 
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each. In this notation, the above zone comprising 3 x 
used for pattern matching consists of the G, H, l, L, 
R, and S pixels and the above target pixel is the M pixe 
12A shows the state after a two-valued pattern of the p 
farmed in the zone comprising 3x3 pixels. 

Fig. 12B shows the pixels after interpolation p 
is executed, where the target pixel M changed to pixel 
of interpolations. To generate such pixels of interpo 
calculation is executed, according to a basic formula, 
given below, for calculating a weighted average of the t 
of selected source pixels with each pixel being given 
of reciprocal ratio of its distance from its correspon 
of interpolation . 
[Equation 1] 



3 pixels 
jM, N, Q, 
1* Fig. 
ixels is 



ore 



x=- 



where, the tone value of a pixel of interpolation to be generated 
is assumed to be X bar, Pn represents the tone values of the source 
pixels to be referenced (selected from among G, H, I, \L r M r N, 
Q, R, and S) , and rn represents the distance from the frixel of 
interpolation to be generated to each of the selectetjl source 
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pixels to be referenced. 

It is a noticeable feature of this interpolation manner 
that the tone value of a pixel of interpolation which is generated 
in this way is obtained from the tone values of the selected source 
pixels. From the multi-tone pixels, each having a discrete tone 
value, a two-valued pattern is created, and then pattern matching 
is carried out. By using the calculation formulas appropriate 
for a pattern found to match with the two-valued pattern by 
pattern matching, the tone value of a pixel of interpolation is 
obtained from the tone values of its surrounding pixels . In this 
way, judgment by pattern patching is carried out, whil^ a pixel 
is generated from its surrounding source pixels, ba^ed on a 
predetermined rule that applies, depending on the matched 
pattern, Thus r natural pixels of interpolations can be 
generated, which, otherwise, could not be obtained only by 
interpolation processing based on simple pattern matching 



Althoug±L_cBlculating the luminance of a pixel from its I., 
B color component values was executed for reference 
hereinbefore, the tone value of a pixel of interpolate 
generated, in fact, consists of the R, G, and B value: 
calculating the tone value of each pixel of interpolation, 
exactly, the reference pixels as source pixels are given 
predetermined - weight by using their R, G, and B values. If 
convenience of calculation is permitted, it is acceptable that 
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the pixels are weighted with their luminance values be Hi 
and the same rate of weight is appl.ied to their R, G, and 
when calculation is executed. 



Because this example pattern of pixels formed in 
comprising 3x3 pixels has little luminance difference in the 
horizontal direction (the i direction of), that is, a horizontal 
lengthening edge, the tone values of only three pixels that are 
placed in a horizontal line are assigned to Pn in the above formula. 
In principle, the tone values of the source L, M, and S pixels 
are assigned to Pn. In the present embodiment of the invention, 
interpolation is executed such that change of luminance in the 
direction perpendicular to the* ^hrwe horizontally lengthening 
edge is also reflected in the interpolation. If luminance 
changes in the direction perpendicular to the horizontally 
ieng theriiny t;dye, ulits tune values of irve source Q, R, and S pixels 
aire assigxied Lo Pn so that the appearance of edge change will 
be reflected in the tone values of the g, h, and i pixels of 
interpolations. If the luminance value of the target pixel M 
is greater (smaller) than that of the pixel R f ormingj part of 

the edge, using the R pixel in addition to the M p|xel for 

t 

interpolation is not effective for highlighting and -{zhus the 
target pixel shall be used as is. 

By reason hereof, the luminance value of the M pjixel and 
that of the R pixel are compared before the calculation for 



g in use 
B values 

the 2one 
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interpolation is executed. If the luminance value of the M pixel 
is greater than that of the R pixel, the tone values of the above 
source 0, Rr and S pixels sre as.signPd to Pn in the above; formula 
and pixels g r h, and i of interpolations are generated. As a 
result, the luminance values of the g, h, and i pfxels of 
interpolations become greater than those of the d, e, and| f pixels 
of interpolations and the edge is highlighted 
interpolation-processed image data* 

The specific condition for making decision in tl 

is : 



in the 



his case 



. ( (M — adg**) C (R ^ M)> or ^ ^ odgs) £ <R < M> ) 

If this is fulfilled, the calculation formulas to be 
generate pixels of interpolations are: 

a = d = <Lx2 + Mx2 + N) /5 

b = e - (L + Mx2 + N) /4 

c = f - (L + Mx2 + Nx2) /5 

g = (Qx4 + Rx6 4- Sx3)/13 

h - (Q + Rx2 + S> /4 

i - (Qx3 + Rx6 + Sx4)/13 
On the other hand, if the luminance value of the M pixel 



used to 



than that of the R pixel, such highlighting is not performed; 



only the tone values of the source L, M f and N pixels a 
The specific condition for making decision in t 



is . 
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is less 



re used, 
lis case 



not ( (M - edge) & (R > M) ) or (M edge) & (R < M) 
If this is fulfilled, the calculation formulas to be 
generate pixels of interpolations are: 

a = d = g - (Lx2 + Mx2 + N)/5 

b-=e = h= (L + Mx2 + N)/4 

c « f = i « (L + Mx2 + Nx2)/5 
When executing the calculation, according to the above 
to obtain the tone values of pixels of interpolations, c 
the luminance value of the source M pixel is assigned to 
the weight of reciprocal ratio of its distance f 
corresponding pixel of interpolation is applied beci 
weight is too heavy if used as is. 

In the present embodiment of the in 
interpolation, processing is executed for a horizont* 
according to the above rules, with luminance change 
direction perpendicular to the edge being tak<3 
consideration. In addition to the horizontal edge, type 
patterns of pixels can be subjected to interpolation p 
and examples thereof are given in Fig, 13. If an edge 
of pixels, shown in Fig. I3A, is found to be the mate 
above step £206, given pixels outside the zone compri 
3 pixels as well as given pixels within the zone are 
to and pixels of interpolations are generated, which a 
in Fig. 13B. In the rule applied to this pattern, 
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calculation to obtain the tone values of pixels a, d, 
and i of interpolations, source L, M, and R pixels a 
For the calculation to obtain the tone values o 



b, c, and f of interpolations, source pixels to be used 
according to the luminance values of given pixels that fa 
the zone comprising 5x5 pixels • If the pattern is a righ 
edge, source L, M, R pixels are used to generate. If the 
is not a right-angled edge, source G, H, N, and S pixels 
to generate pixels b, c, and f of interpolations* 

First, the condition for deciding that the present, 
is a right-angled edge is: 

( { {M = K = edge) £ ( F — not edge) ) or ( (M - W - edge 
not edge) ) } 

or 

( ( (M = K ~ not edge) & {F = edge}) or { (M = W — not 
{X - edge) ) ) 

If this is fulfilled, the calculation formulas to be 
generate pixels of interpolations are: 

c - (L + Mx2 + R) /4 

b = (Lx4 + Mx6 + Rx3)/13 

f = (Lx3 + Mx6 + Rx4)/13 

a = (Lx2 + Mx2 + R) /5 

d = (Lx3 + Mx3 + Rx2) /8 

e = (L + Mx2 + R} /4 



e, g, h, 
e used, 
f pixels 
dif f er, 
1 within 
:-angled 
pattern 
are used 



pattern 



) S (K- 



edge) & 



used to 



g = (L + M + R) /3 

h = (Lx2 + Mx3 + Rx3)/8 

i = <L + Mx2 + Rx2>/5 
Then, the condition for deciding that the present pattjern is a 
first pattern approximating to the right-angled edge, though not 
forming a right angle is: 

( { (M = F - edge) & (A « not edge) } or ( (M = X = edgej) & (Y = 
not edge) ) 



or 



used to 



( ( (h = F = not edge) & (A - edge)) or ( (M = X = not 
(Y = edge) ) ) 

If this is fulfilled, the calculation formulas to be 
generate pixels of interpolations are: 

c = (G + Hx2 + Nx2 + S>/6 

o = + Mxb + Rx3)/13 

f = (Lx3 + Mx6 + Rx4)/13 
To generate other pixels a r d, e, g, h, and i r the same calculation 
formulas as for the first condition are used. If neither of the 
above two conditions for making decision is fulfilled,- the 
calculation formulas to be used to generate pixels of 
interpolations are: 

c =• (G + Hx2 + Nx2 + S) /€ 

b = (Gxl5 + Hx30 + Nx20 + Sxl2)/77 

f = (Gxl2 + Hx20 + Nx30 + Sxl5)/77 

-58- 



edge) & 



To generate other pixels a f d f e, g, h, and i, the same cal 
formulas as for the first condition are used. 



emulation 
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ven 



Furthermore, if an edge pattern of pixels , shovqi 
13c, is found to be the match, pixels of interpolat 
generated, which are shown in Fig. 13D, Because the 
shown in Fig* 13C is regarded as forming a diagonal line 
with an angle of 45 degrees) in the zone comprising 3x3 
source G, M, and S pixels which are elements forming this 
line are used to generate pixels a, e, and i of interpo 
At the same time, the edge angle and line thickness of 
pixels are decided, based on the luminance values of gi 
that fall within the zone comprising 5x5 pixels, A 
to this decision, selection is made between source " 
pixels and "G, M, and S" pixels or source "L and R" pi 
"G, M, and S" pixels and the selected pixels are used to 
pixels b, c, f, d, q, and h of interpolations. 

Depending on decision whether the detected edge 
angle of 4 5 degrees forms part of its extending edge with 
of 4 5 degrees or part of an edge with an angle of 30 
the processing flow branches into three processe 
conditions for making this decision and subsequent deci 
specified in Fig, 36. The intention for which each de 
marip _t q rte scribed in a box djrawn with dotted linee* 

If process 1 is selected, the calculation forznul 
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used to generate pixels b, c, and f are: 

b = (Gx5 + MxlO + Sx4)/19 

c = (G + Mx2 + S}/4 

f = (Gx4 + MxlO + Sx5}/19. 
If process ? is selected, the calculation formulas to be used 
to generate pixels b, c f and f are: 

b = (GX5 + mxio + 5X4) /iy 

c - (H + N) /2 

f = (Gx4 + MxlO 4 Sx5)/19 
If process 3 is selected/ the calculation formulas to be used 
to gpnara.te pixols b, c, and f are: 

b = (Hx3 + Nx2) /5 

c = "t*H + N) /2 

f = {Hx2 + Nx3) /5 
For generating other pixels, the calculation formula^ are: 

a = (Gx3 + Mx6 + Sx2) /ll 

d - <Gx5 + MxlO + Sx4)/19 

e « (G + Mx2 + S) /4 

g = (G + Mx2 + R) /4 

h = (Gx4 + MxlO + Sx5)/19 

i = (Gx2 + Mx6 + Sx3)/ll 

Furthermore, if an edge pattern of pixels, showit in Fig, 
13E, is found to be the match, pixels of interpolations are 
generated, which are shown in Fig, 13F. Because the line) pattern 
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■shown in Fig, 13E is regarded as a smaller-angled line 
with an angle of 30 degrees) than the line shown in 
source G, M and N pixels that form this line pattern 
to generate pixels a, b, c, e, and f of interpolations 
same time, the edge angle and protrusion of the sourc 
are decided, based on th#= .Lnm ina ar^xa lu p s. r>f givprv niv 
fall within the zone comprising 5x5 pixels. According 
decision, selection is made between source "G, M and N 
and "L, R, and S" pixels and the selected pixels are 
generate pixels d, g, h, and i of interpolations. 

More specif really, the flow of processing for the 
edge with an angle of 30 degrees branches into four pr 
The conditions for making decision required for this p 
are specified in Fig. 37. The intention for which each 
is made is described in a box drawn with dotted linei 
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If process 1 is selected, the calculation formul 
used to generate pixels d r q, h, and i: 
d - (G + Mx2 + N) /4 

0 a (G +. Mx2 4- S) /A 
h = (Gx3 + Mx8 + Nx5)/16 

1 = (G + Mx3 + Kx3) /7 
If process 2 is selected, the calculation formulas to 
to generate pixels d, q, h, and i: 

d » { G -h Mx2 + N) /4 
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g = (Lx2 + Rx2 + S) /5 

h = (Lx4 + Rx6 + Sx3)/13 

i = <Lx3 + Rx6 + Sx4) /13 
If process 3 is selected, the calculation formulas tcj be used 
to generate pixels d, g, h, and i: 

d - (G + Mx2 + N)/4 

g = (Lx2 + Rx2 + S) /5 

h = (Lx4 + Rx6 + Sx3)/13 

i (G + Mx3 + Nx3) /7 
If process 4 is selected, the calculation formulas to "be used 
to generate pixels d, g, h, and i: 

d = (LxlS + RxlO + Sx6}/31 

g = (Lx2 + Rx2 + S) /5 

h - (Lx4 i RkG i 3x3) /13 

i = {Lx3 + Rx6 + Sx4) /13 
For generating other pixels, the calculation formulas are; 

a = (Gx4 + Mx6 + Nx3}/13 

b = <Gx3 + Mx6 + Nx4) /13 

c = (G + Mx2 + Nx2> /5 

e = (Gx4 + Mx6 + Nx3>/13 

f = (Gx2 + Mx5 + Nx5)/12 



Ttie eage patterns, "tne method of referring to 
■ ccjnp-z-ioin-g-5 ->< S-pi-Kcls , and the; method of aclcuLiuy i?uui> 
to be used, have been described above far illustrative 
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A variety of other manners thereof may be taken. The 
rate at which pixels of interpolations are generated is 
In the above description, pixels of interpolations are 
in a rectangle with its vertical and horizontal edges 
three times the corresponding edges of the target 
interpolation > This magnifying rate may be changed to t^ 
four times, or other desirable rate* 

First r exemplary interpolation to which the ma 
rate of two times ap^li«;> will now be explained* Fl 
42 exemplifies such interpolation processing by which 
to d of interpolations are generated from the source 
Refer to Fig, 38 where it is assumed that a horizontal 
been found i n the zone by pattern matching. Also for this 
if the luminance value of the target pixel M is greater ( 
than that of the pixel R forming part of the edge, us 
pixel in addition to the M pixel for interpolation 
effective for highlighting and thus the target pixel 
used as is. The more specific condition for making decijs 

( (M = edge) & (R > M) ) or ( = not edge) & (R < M) 
If this is fulfilled, highlighting is executed- The cal 
formulas for this highlighting are: 
a - b = M 



magnify 3 
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riable. 
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o times, 
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M 



Otherwise, highlighting is not executed and the following 
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calculation formula is applied: 
a=b = c = d = M 

Then, refer to Fig- 39 where it is assumed that ar 
edge has been found in the zone by pattern matchi 
condition for making d&cision whether the detected e 
right-angled edge is: 

{ ( <M - K = edge) & (F = not edge) ) or < (M = W = edge 
not edge) ) ) 

or 

{ { (M = K - not edge) & ( F = edge)) or < (M = W = not 
(X = edge) ) ) 

If this is fulfilled, to highlight the light-angle 
the edge, calculation for generating pixel b is 
according to the following formula: 
b = (L + R) /2 

Otherwise, the above calculation is executed, accordir 
following formula : 
b = (Gx2 + Hx3 + Nx3 + Sx2)/10 

For generating other pixels, the calculation formula 
a = (Lx3 4 Rx2) /5 
c = (L + R) /2 

Refer to Fig, 40 where it is assumed that an 
an angle oi degrees has" been found in the zone by 
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matching. In order to decide whether the detected e 
part of its extending edge with an angle of 45 degrees o 
with an angle of 30 degrees, decision is made, subj 
conditions which are specified in Fig. 41, and the 
flow branches into two processes, depending on this deed 
subsequent decisions. In Fig* 41, if process 1 is appl 
calculation formula to be used to generate pixel b i 
b = (G + S) /2 

If process 2 is applied, the calculation formula to be 
generate pixel b is: 
b = (H + N) /2 

For generating other pixels , the calculation formula 

a = {Gx2 + S) /3 

c - (G + S) /2 

d = (G + Sx2}/3 

Refer to Fig. 42 where it is assumed that an 
an angle of 30 degrees has been found in the zone by 
matching. Depending on the decisions to be made subje 
a on ri 1 1" *i nns which are specified in Fig. 43 r the process 
branches into three processes. In Fig* 43, if pre 
applied,' the calculation formulae to be used to gcnciat 
c and d are: 

d = (G + Nx2>/3 
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If process 2 is applied, the calculation formulas to used to 
generate pixels c and d are: 

c « (Lx3 + Rx3 + Sx2) /8 

d = {Lx2 + Rx3 + Sx3>/8 

If process 3 is applied, the calculation formulas to be used to 
generate pixels c and d are: 

c m (Lx3 + Rx3 + Sx2) /8 

d - {G + Nx2}/3 
For generating other pixels, the calculation formula^ are: 

a « (Gx3 + Nx2) /5 

b - <Gx2 + Nx3) /5 

If the judgment is a mismatch between the ab 
valued pattern of the reference 3x3 pixels and ani 
prepared edge patterns of pixels formed in the abo 
comprising 3x3 pixels, the nearest method is executed 
of using the pattern matching method described above as t 
interpolation processing * The concept of the nearest 
illustrated in Fig* 14 where the distance between each 
surrounding grid points Pi j , Pi + lj 7 Pij +1, Pi + ij 
a desired point Puv to be interpolated is obtained and 
of the nearest grid point is given to the desired poinjt 
This can be expressed in a general equation as below 
Puv = Pij 

where i = [u + 0.5] and j = [v + 0.5] . Brackets [ ] denote 
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that Causo 1 symbol integers ore given. 

Fig* 15 shows pixels of interpolations increas 
times the source in both vertical and horizontal direct 



du 3l 



ho:r 



the nearest method. Before interpolation, it is ass 

there are four pixels (DAOf ) at the corners* When 
interpolations are generated, the nearest pixel data 
four pixels is given to them as is. That is, as rega 
example, each of the four pixels at the corners is 
to pixels of interpolations adjacent to it. By this pr 
an source image which is shown in Fig. 16 where black pi 
arranged diagonally against a background of white pixels 
to an -irruagc -which is shown in Fig. 17 wnere black pi 
enlarged three times the source in both vertical and 
directions while they remain arranged diagonally* The 
method has a feature of keeping the edges of an image as is 
after the image is enlarged, its edges remains unchanged 
jaggy contours are found. 

After pixels of interpolations are generated by 
interpolation processing in the manner described above 
the above-mentioned rate is "1," the second inte 
processing is further executed. In the present 
the invention, interpolation by the cubic method is 
the second interpolation processing, which will be 
below. In the cubic method, as is shown in Fig. 18, 



unec 



pixel; 
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four grid points surrounding a desired point Puv to be 
interpolated, but also outer grid points that further surround 
the four grid points, a total of 16 grid points are used. 

When the 16 grid points surrounding the point Puv to be 
interpolated are given their tone values, the luminance of the 
point Puv is determined, subject to the influence of these tone 
values on the point Puv, For example, if interpolation is 
executed, based on a linear expression, the tone values of two 
grid points between which the point Puv exists are added with 
each point being given a weight in inverse proportion to its 
ri i flf^nrp f mm th^ point Puv. When taking notice of the X axis 
direction, we express the distance of the above 16 grid points 
from the point Puv as follows: the distance to the ouber left 
grid points is xl; the distance to the inner left grid points 
is x2; the distance to the inner right grid points is x3; and 
the distance to the outer right grid points is x4. We use 
function f (x) to express the degree of influence of -he tone 
of the gird points on the luminance of the point Puv, according 
to the above distance . When taking notice of the Y axis di rection, 
we express the distance of the above 15 grid points from the point 
Puv as follows: the distance to the top grid points is yl, the 
distance to the inner grid points above the point Puv is y2, the 
distance to the inner grid points below the point Puv is y3, and 
the distance to the bottom grid points is x4. Similarly, we use 
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function f (y) to express the degree of influence of the tone 
of the gird points on the luminance of the point Puv, according 
to the above distance. 



nterp 



The 16 grid points act on the point Puv to bo i 
with the degree of their influence depending on their 
from the point Puv, which is expressed as described 
degree of influence of the tone data of all grid point 
point Puv in the X and Y directions in the aggregat 
expressed in a general equation as below: 



olated 
distance 
above. The 
s on the 
can be 



[Equation 2] 



|NCf<y1)f(y2)f<ya>f(y4)] 



Pit P21 P31 P41 
P12 P22 P32 P42 
P13 P23 P33P4S 



PU P24 m P44 



f.(x2) 
fix A 



Hereupon, the degree of influence of the grid points on 
the point Puv depending on their distance can be expressed by 
a cubic convolution function as below: 

f (t) = {sin (« t) } / 7t t 
Using the absolute values of the coordinates {u,v) of tjhe point 
Puv, we can calculate the above distance values of xl t|o x4 and 
yl to y4 as follows: 

xl = 1 + (u - |u|) yl » 1 + (v - 1 v | > 
x2 = (u - |u|) y2 - {v - Ivi) 
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X 3 - 1 - (u " lul) y3 = 1 " (v " ivl) 
4 - 2 - <u - lul) y4 = 2 - (v - Iv|) 



x 



On the above as sump t 



ion, we develop P as foil 



[Equation 3] 



P13-fW)*P23'f(«2)-»t»33-f(x3)+P43-f0(4) 
^P14-f (x1)+P24- f fcBW f (x3)+P44- f <x4}J 



+f fr2) 0*12«f W)+P22-4fea*P32'*0e)<P«-f MM 
+f (y3) (Pt3^0rl)+P23'*(x2)*P33'f (3a)*P43-f (x4)) 
*f (yD IP14-f W)*P24-*0dD*P34-f W)*44-f U4N 

*P12»f(x1)'f^*P22-fO©*f(^^'^-^^*(«4)'*<v2> 



ows : 



As is called the cubic convo 



lution function, the functi 



of the degree of influence of the grid points on the p 
depending on their distance is approximated by the 



cubic expression: 



on f (t) 
aint Puv 
fallowing 



[Equation 41 

fit) - {iln(*t»/*t 

ji-!ltM»rtM- :0*|t|<i 
< Nt*ltMJtl««*> ltl«3 ltl<2 

This — cubiG method is- characterized in that 
gradually changes during the move from one grind point 
another P which is known as mbic functionally dependent 

Figs. 19 and 20 presents sample data on inte 
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processing by the cubic method. Foi. easy uriderstrandxn 
a model of pixels where a horizontally lengthening edge is 
but no pixel data change occurs in the vertical direfc 
explain this interpolation processing. It is assumed th 
pixels are interpolated. 

Sample values listed in Fig. 20 are first expla 
the "Source" column at the left, the tone values of th 
before interpolation are given. In this column, from 
to down, there are four pixels [P0, PI, P2, P3) with a 
of "64" , one pixel (P4) with a tone value of "128 , " and fi 
{P5, P6,F7, P8 f P9) with a tone value of "192". The edge 
of the pixel with a tone value of "128." 

Three pixels (Pnl, Pn2 r Pn3) axe to be interpolated 
between the source pixels with distance between thes£ pixels 
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being "0.25." The above distance values xl to x4 for each point 
to be interpolated are given in the columns in the middle of the 
table- For the values of xl to x4, functions f {xl} to f (x4> 
are separately calculated. When xl, x2, x3, and x4 are, for 
example, "1.25," "0.25," "G.75," and "1,75," respectively, the 
f (t) calculations for each are approximately "-0,14," "0.89," 
,r CK-30 7 " and "-0.05." When xl , x2, x3, and x4 are "1,50," "0.00, " 
"0. 50, " and "1 . 50, " respectively, the f (t) calculations for each 
are approximately "-0-125, M "0.625, " "0.625," and "-0*125," 
When xl, x2, x3, and x4 are "1.75," "0.75," "0.25," and "1.25," 
respectively, the f (t) calculations for each are approximately 
"-0^05," "0,30," "0.B9," and "-0.14." By using the above results, 
the tone values of the points to be interpolated are calculated. 
The results of calculation are given in the rightmost column of 
the table and plotted in a graph which ia yhowri in Fig. 19, What 
is meant by this graph will be described in detail later. 

As no pixel data change in the vertical direction is 
assumed, arithmetic is simplif ied . Only trie pixel data or the 
four grid points (Fl, P2, ?3, F4) placed in the horizontal 
direction must be referred to. By using the function f (t) of 
the degree of influence of the grid points on a point to be 
interpolated, depending on their distance from that point, the 
cubic value (tone value) of the point to be interpolated can be 
calculated as follows: 
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P - PI • f (xl) + P21 f (x2) + P3 • f (x3) + P4 
Hence, the cubic value (tone value) of point 
interpolated is calculated as follows: 

P21 « 64*f {1.25} + 64* f (0.25) + 64*f (0.75) 



P21 



(1.75 



- S4 + ( 0-14063) I £$4 + (0. 090G25) 1 C4* ( 0 . 2 2C07 S) I 



128* (-0.04688) 
- 61 

According to the cubic method, tone change is expressed 
cubic functionally and thus the quality of interpolation result 
can be adjusted by adjusting the obtained curve shape; 

As examples of trie adjustment , the rollowlng are given 

0 < t < 0.5 £ (LJ - -(8/7) L**3 - (4/7) L * A 2 + 1 
0.5 < t < 1 f (t) - (1 - t) (10/7) 

1 < t < 1.5 f (t) « {8/7} (t - 1}**3 + (4/7) (t - 1)**2 
- <t - 1) . 

1.5 < t < 2 f (t) = (3/7) (t - 2) 
Such adjustment is referred to as a hybrid-by-cubic method or 
an M (Modified) cubic method. 

Fig. 21 presents sample data on interpolation processing 
by the M-cubic method, which lists the results of this 
interpolation for the model on the same assumption as for the 
cubic method- The result of interpolation processing by the 
M-cubic method is also shown in Fig. 19 vrhcrs the cubic functional 
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curve of the H-cubic example becomes slightly steeper 
curve of the normal cubic method, correspondingly ma|ki 
parts of the image somewhat sharper. Whether the M-cub± 
or the normal cubic method is used, once pixels of intcrpf? 
have been generated by the cubic method in the above st^p 
second interpolation processing, all parameters to be 
to the above calculation equation for data to be blende^ 
obtained: i.e., data generated by the first inte 
processing, rate, and data generated by the second interfc>ol 
processing. By assigning these parameters to the above e 
calculation of the pixels of interpolations data to be 
at a ratio between the first and second interpolations is 
executed. 

Using example image data which is shown in Fig* 22A, the 
data processing procedure up to the blending step will be 
explained below. Hereupon, it is assumed for this explanation 
that the number of discrete luminance values Y appearir 
zone comprising 5x5 pixels around the target pixel is 
than 15 and the above-mentioned rate is neither "0" nor n l 



than the 
ng all 
c method 
lation3 
of the 
assigned 
are now 
olatian 
ation 
quation, 
blended 



after the rate is calculated in the step £108, th 
interpolation is executed in the step S114 - The zone ( 
solid lines) comprising 3x3 pixels around the targe 
shown in Fig. 22A, is extracted in the step S202 and a 
pattern of the pixels, which is shown in Fig. 22B f is 
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from the pixel <Ja Lu in Lhcrt zune. 

As this two-valued pattern of the pixels mat 
corresponding given edge pattern prepared in advance, p 
by the pattern matching method is executed in the step 
pixels of interpolations which are shown in Fig. 22C are 
By this processing, from the 3x3 pixels shown in Fig. 2 
an edge appears in the diagonal direction with the 1 
gradient toward the left bottom, pixels of interpolat 
in Fig, 22C are generated where the property of the 3 x 
is reflected; i.e. the edge in the diagonal direction 
as is and the luminance gradient toward the left bottom hi 
the edge. 

On the other hand, in the step S118, from the pi 
shown in Fig. 22A, pixels of interpolations which are 
Fig. 22D are generated- Hereupon, to generate a 
interpolation, d^t^ nf 16 pixels surrounding the pixel 
For example, to generate a right top pixel with a black 
in Fig. 22D f 16 pixels in the zone drawn with solid an 



3hes the 
cessing 
208 and 
generated* 
2R where 
Urainance 



dct 



1 irvs s - frh awi-i n PI cr . - 2 2 A , 



!-nrsH- I n i- H <■= fHS t.i ^ <2^n«-r «. fc«ci pixels 



of interpolations,, subtle tone difference between the 
the above zone drawn with the solid and dotted lines is 



due to the characteristics of the cubic method, while the edge 
is made vague as contrasted with the edge made by the above pattern 
matching method. That is, the edge appears in the piagonal 
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direction of the rectangle comprising the pi 
interpolations, but the luminance gradient toward 
bottom becomes moderate and this makes the edge vagu^ 

After the pixels of interpolations are generat 
first and second interpolation processing, the pi 
interpolations generated by the first interpolation 
are multiplied by rate and the those generated by th 
interpolation processing are multiplied by (1 - rate) 
way, blended pixels of first and second interpolation 
are shown in Fig. 22E r are generated* Once the ble 
of first and second interpolations to the target pixel, 
in Fig. 22E, have been qenerated, the judgment in the s 
is made. As long as another target pixel of interpolatic 
in other coordinates, the interpolation procedure is 
When all target pixels have been processe 
interpolation-processed i maq<$- ctata is transferred to 
.process in the step S124 . However, depending on the 
rate of interpolations f the amount of the /inte 
processed image data may become quite huge* There 
hardware limitation; i.e., the available memory area 
printer driver 12c is not so much* In this case, the 
may be output in blocks of a given amount. 

Finally, a general view of the present embodiment of the 
inveintiori \a shown in Fig. 34. The scanner 11a. scans a photograph 
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and generates digitized source image data that is pro 
the following processes. The unit to acquire this sour 
data is the image data acquisition unit Cll. 

In the step S1G4, the source image data is re 
.histogram of luminance -values in the zone comprising 5 x 
d^uiiU target pixel ic created, in the step LllVb, tii 



ces 



sed in 
ce image 

ad and a 
5 pixels 



of discrete luminance values appearing in the created h 
is counted- If this count is less than a predetermined 
the attribute of the image is simply regarded as a non 
picture and the blending ratio (rate) of interpclatio 
first interpolation processing to those by the 
interpolation processing is set to 1. if the count is 
than the threshold, the attribute of the imacre is r 
a natural picture or a mixed image of natural and non 

Diet ores and t*.hP. r^tP 1*5 r?^t" *=» r~m i nor] *hy f- V> o oTralnation 

F. This evaluation function F is a function of 
between the maximum luminance value Ymax and the 



ecr-a 



diff 



luminance value Ymin in the above zone and sets the 



a tio 



evaluating edge-like visualization. The unit to qbtain a 
blending ratio between the first and second interpola 
this way is the first unit of determining a blending r 
In the step S114, interpolation processing is 
within the predetermined zone around the target pixe 
pattern matching method or the nearest method 
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interpolation that tends to keep the edge intact is carried out 
by the first interpolation processing unit C12. 

On the other hand, in the step S118, int 
processing is executed by the cubic method in which s 
difference between the pixels is reflected, while the 
made vague, as contrasted with the edge made by the 
matching method. This interpolation is carried out by th 
interpolation processing unit CI 3. 

Then, in the step S120, the data of pixels 
interpolated by the first and second interpolations are 
and added by the equation (1) to which the blending rati 
determined as described above is assigned and blended 
first and second interpolations are generated . The t 
of the blending ratio, of course, becomes "1." This 
carried out by the image data blending unit CIS. 

Following that, the above procedure is repeated 
target pixel being changed until all target pixels 
processed. Then, an interpolation-processed image is 



Thus, ccn;plctcly int^lpuiaL j.vu~pi.uucoaca -Linage; uaLO j_ 



lmig 



in the step S124. This step is carried out by the i 
output unit C16. By way of example, if the image is o 
the printer 17b, its print will be produced. 

Next, another preferred embodiment of the 
invention will be described below. In this second 
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embodime 



a printing system uses the image data interpolation 
Components used in common with the forgoing first 
referred to as in the foregoing description. 

To the above-mentioned printer 17b, the re 
processing of the application 12d is output through the 
driver 12c. as print -data. The color printer 17b prints 
from the data by printing the dots of the image on printi 
with color inks. 



suit of 
printer 
e image 
ng paper 



th 



nter 



21 as 
125, The 



The outline structure of a color ink jet pri 
an example of the color printer is shown in Figs, 23 to 
color ink jet printer 21 is equipped with a dot printing mechanism 
consisting of a print head 21a comprising three print hea|d 
a print head controller 21b that controls the print h 
a print head shift motor 21c for moving the print hea 
the shift direction, a paper feed motor 21d for feeding 
paper in the line feed direction, and a printer cnnr.ro 
for interfacing these print head controller 21b, print he 
motor 21c, and paper feed motor 21d with external e 
color ink jet printer 21 can print an image while s 
print head 21a on an image recording medium which is 
paper, according to the print data. 

Fig. 24 shows the internal structure of the priLnt head 
21a. Fig. 25 illustrates the ink jet mechanism. Inside the 
print head 21a, a narrow pipe line 21a3 from a color Ink tank 
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units, 
*ad 21a, 
i 21a in 
printing 
1 1 er 21e 
ad shift 
The 
the 
printing 



are made of flexible material and are furnished with 
element 21a5 that is an electostriction device. When 



cture is 



and the 



21al to nozzles 21a2 is formed and terminates at a section where 
an ink chamber 21a4 is formed. The walls of the ink cairjber 21a4 

a piezo 
voltage 

is applied to the piezo element 21a5, its crystal stru 
distorted and the element performs rapid electrp.cal-to- 
mechanical energy conversion. By the distortion of the) crystal 
structure, the wall of the ink chamber 21a4 is pushed 
capacity of the chamber 21a4 decreases. Then, a giveh amount 
of color ink particles are jetted out of the nozzles 21a2 provided 
at the bottom of the ink chamber 21a4 This pump stru 
referred to as a micro-pump mechanism 

On one pxint head unit, two independent rows of 
21a2 are formed so that particular color ink wa.ll be 
iu eddi row of no z~z 1"5"S " 2Ta 2*.~ ~ t hus , mree print neaa un 
have two rows of nozzles and a maximum of six color ink 
used. In the printer exaraplft shown in Fi (j , 23, it is 

that color inks are used in the following manner: a black ink 
is supplied to two rows of nozzles of the- left print head unit, 

a cyan ink is supplied to only one row of noazles of th|a middle 

print head unit, and a magenta ink and a yellow ink are se 
supplied to two right and left rows of nozzles of the rigjht print 
head unit. 

Spacing of the nozzles 21a2 in the row lengthwise 
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direction,, formed on the bottom surface of the print 
does not agree with the resolution of printing. In gene 
spacing of the nozzles 21a2 is larger than the reso 
printing. Notwithstanding, the printer is able to prin 
resolution because the paper feed motor 2 id is contrb 
appropriately feed paper in the line feed direction. For 
if paper is fed in eight steps over the distance of the 
of the nozzles 21a2 and the print head 21a is moved in t 
direction for each step, the printing resolution increa 
the shift direction, because jetting color ink at 
intervals determines resolution, it can be said that re 
depends on timing control. Exactly speaking, the dot 
of color ink is also considered as a factor in det 
resolution, but this is ignored for easy under£t 



a:rb 



di 



convenience , 

In the second embodiment of the invention, it is 
that the invention is embodied on the above-mentioned 
system and pr i nt i ntj-Ls executed, based on the image data 
by the image input device of the computer system 10. 
is difference between the resolution of the source 
and the resolution of the color printer 17b, inte 
processing is. executed. The; foil nwinrj wi 1 1 .explain 

operation flow: after the application 12d starts to 
processing, change is made to the resolution and tone of 
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data and the print data that reflects this change is ojutput to 
the color printer 17b. 

Fig. 26 illustrates the flow of image data. The 
appl i c.a 1" \ nn 1 ?ri p nrinl- r^qn^Qf -ho tr^»o operating system 



iica 



ooe 



ys 



12a, when the application passes the parameters of outp 
printing paper, print speed, and ink type, as well as i 
in RGB 256 tones to the operating system. Then, the 
system 12a passes these parameters and the image dat 
printer driver 12c. At the same time, the operating s 
displays the image on the display 17a by means of the 
driver 12b and transfers the result of user operation 
keyboard 15a and the mouse 15b to the printer driver 1 
printer driver 12c executes image interpolation proce 
that the specified output size will be obtained, and g 
prinL data. This print data, which is usually in CMYK tv* 
is output to the color printer 17b from the hardware po 
the control of the operating system 12a. 

In the second embodiment, the print control 
--e-Atrcut/edr-oxj triit* -computer system 10 in this way and the 
is output to the color printer 17b. However, the 
printer is not limited to the above color printer 21 of 
type. Although this color printer is, for example, an 
type that uses micro-pump mechanism, other mechanisms can 
A pump mechanism of bubble jet type is put into practi 
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be used. 
1 use, 



as is shown in Fig, 27 f where Lhe wall of a pipe line 
furnished with a heater 21a8 near the nozzle 21a6* As 



the 



ink is heated by the heater 21a8 f a bubble is gene 
eventually the color ink is jetted out by the press 
bubble . 



r a 



ure 



:ture 



ren 



Furthermore, Fig. 28 shows the outline struc 
primary part of what is called an electrophotograph 
printer 22 as another mechanism. Along the circumfe 
rotary drum 22a as a photosensitive body, a charger u 
an exposure unit 22c, a developer unit 22d, and a trans 
22e are arranged in position in harmony with the dire 
rotation- After the <jhccrgei* ~ anit 22ir~ urrirf ormly ch^. 
surface of the circumference of the rotary drum 22a, the 
unit 22c discharges the drum surface where an image is c 
the developer unit 22d makes toner cling to only the di 
surface of the drum, and the transfer unit 22e transfers t 



onto paper as an image recording medium. Then, as pape 
between a heater 22f and a roller 22g, the toner is 
fixated nntn thf* n^pp r R^r^n^^ a set of these units 



out printing by using one color toner, four sets for £ll four 
colors are provided 

In short, there is no particular limitation on the 
practical structure of the printer. Not only the application 
range of particular printing methods as described above but also 
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the application manner may be varied* 

Next, procedure in which optimum image procejs 
executed by using the above printing system, accordin 
output resolution , will be explained below. 

Fig, 29 is a block diagram showing the 
configuration of this printing system* A print 
parameters acquisition unit acquir&s print 

parameters, according to which the input image is printed 
activated print job, A first interpolation processing 
and a second interpolation processing unit C23 
interpolation processing by which the number of 
constituting the image data multiplies* The first inte 
L tt i K •^^•ss-±Ti^-arrJrt "CI 2" isr able tc* execute trie pattern matchir. 

and the nearest method as interpolation processing* Th|e 
interpolation processing unit C13 is able to execute t 
method as interpolation processing. 

A second unit of determining a blending rc 
UeLttiiuiiitjs a Dienaing ratio oetween tne - pixels xnterpo 
the first interpolation processing unit C12 an<(i 
interpolated by the second interpolation processing uh 
based on the print quality parameters acquired by the abofve 
quality parameters acquisition unit C21. Once the sec 
of determining a blending ratio C24 have determined a : 
ratio, an image data blending unit C25 blendes Llae dciL 
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pixels interpolated by the first interpolation process 



C22 and the data of the pixels interpolated by thf second 
interpolation processing unit C23 at that blending ratid. Then, 
an image data output unit C2 6 generates printing data and [executes 
printing, based on the pixels data blended by the imjage data 
blending unit C25. 

Fig. 30 is a flowchart illustrating the [software 
operation flow regarding the print processing that the above 
printer driver 12c executes, In Fig. 30, source image! data is 
acquired in step S302, For example, during process sequence in 



which an image is scanned by the scanner 11a under the 



ing unit 



control 



of the application 12d, the image data is processed by 
predetermined image processing, and printing from the inlage data 
is executed, image data of predetermined resolution ijs passed 
via the operating system 12a to the printer driver 12c land this 
stsrjp corresponds to the stap S302. 

In step 303, print parameter settings are input. When 
the application 12d starts to execute print processing if it 
is assumed that the operation system 12a provides the GUI 
environment r a print operation window like the one which is shown 
in Fig. 31 is displayed. Although parameters to be input on this 
window may be varied, those in the present embodiment are| "Copies 
(or pilars) , " "start fage, " ana "hind Page. " As operation! command 
buttons, the "OK" button, the "Cancel" button, and the TPrinter 
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Setup" button are provided. 

When you choose the "Printer Setup" button, a wir 



.dow like 



trie one which is shown in Fig. 32 is displayed. This window is 



provided to allow the user to set print parameters w 
varied, depending on the printer-specific capability, 
be described later, depending on the settings specified 



lich are 
As will 
on this 



window, a blending ratio changes. In the present embodiment, 



the user can select either "360 dpi" or "720 dpi" as "Res 
(of print) . " Furthermore, the user may select "A4" or 
and "Plain Paper" or "Glossy Print" quality as "Paper, 

or- .''Low" " * Print Speed." and "Pigment." or "Dye" as w I 

course, these print setting parameters are examples. I 



necessary that the printer setup window be embodied to allow the 



embodied 
that the 
ication 



user to select all these parameters. This window can be 
in various ways, for example , it can be designed such 
user can specify an ink type through bidirectional cornmuii 
with the above color printer 17b. 

In the present embodiment, the settings of th 
parameters arc otorcd into a setup file under the manog 
the operating system 12a. If these parameters have pre 
been set, the setup file is referred to and read. If the operator 
changes the settings for print operation, the updated settings 
are read as the set^-print parameters. The processing 
step S303 is regarded as the step or function of print 
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sment of 

viously 
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quality 



parameters acquisition from the software point of view. However, 
it can be understood that the description of all steps including 
this step of print quality parameters acquisition to be fexecuted 
by the computer does not directly include the operation of the 
operating system 12a itself and hardware* On the other hand, 
if* this step is considered to be implemented as par": of the 
organically integrated operation of the hardware including the 
CPU, it corresponds to the action of the print quality pa 
acquisition unit C21 . 

In step S304, a pixel in the read image data i: 



a target of interpolation, the pixel data in a zone comprising 



nameters 



s set as 



pixels, 
e pixels 
jminance 
judgment 
greater 
1 be the 



5x5 pixels around the target pixel is set to be reference 
and a histogram of the luminance values of the reference 
is created. In step S306, the number of discrete 1 
values appearing in the created histogram is counted and 
is made as to whether this count is less than 15. The 
the number of discrete luminance values, the greater wi:.: 
number of colors assigned to the reference pixels. From this 
fact, if the number of discrete luminance values appearing in 
the histogram is less than 15, the reference pixels are regarded 
as the pixels belonging to a non-natural picture. When the 
judgment is the above step S306 is that the number of discrete 
luminance values appearing is less than 15, a blending ratio 
(rate) of interpolations by the above first interpolation 
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processing to those by the second interpolation pro 
set to 1 in step 310. 

When the judgment in the step S306 is that th 
of discrete luminance values appearing is not less t 
evaluation function F is selected in step 307 r bas 
settings of the print parameters input in the above s 
In the step 307 f if high print quality is set, an 
function F is selected that gives a high blending rati 
pixels interpolated by the second interpolation proce 
those interpolated by the first interpolation. In the 
embodiment/ two types of evaluation functions are prepa 
for high print quality and the other for low print quali 
detail thereof will be described later. The value 
evaluation runctioii rornign print quality is smaller 
value of the evaluation function for low print quali 
evaluation function F is a function of the width of t 



cessxng is 



within which the luminance values of the above referencje 
fall, that is, the difference between the maxiiauni luminau 



Ymax and the minimum luminance value Yrain among the reference 
pixels . 

In step S308, to the evaluation function F selected in 
the above step S307, the difference between the maximum luminance 
value Ymax and the minimum luminance value Ymin based on t)he above 
histogram is assigned and the rate is determined. Titus, the 
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sequence of the steps S304, S306, S307, S308, and S31Q corjre 
to the second step or function of determining a blendin 
If- t^ese steps -are— considered to be implemented as pait 
organically integrated operation of the hardware inc 



luding 



irg 



CPU, they are defined as the action of the second 
determining a blending ratio C24. 

After the rate is determined in the step S308 or 
S310, judgment is made as to whether the rate is "0" in st 
When the rate is "0," the first interpolation process 
executed. When the judgment in the step S312 is that 
is other than "0, " the first interpolation processing is 
in step S314 . Thus, this step corresponds to the step or 
of first interpolation processing* If this step is 
to be i TTinl ftTn^n t a « p^r-h nf t-h^ organically integrated 

of the hardware including the CPD, it is defined as 
of the first interpolation processing unit C22. 

Then, in step S316, judgement is made as to 
rate is "1." When the rate is "1," the second inte 



processing is not executed. When the judgment in the s 
is that the rate is not ir l, " the second interpolation 
is executed in 3tep S31G. Thus, this step correspond 
step or function of second interpolation processing, 
step is considered to be implemented as part of the org 
integrated operaLiuu u£ the hax.dwctx.fcj including the C 
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ssxng 
5 to the 

If this 
L nically 
, it is 



defined as the action of the second interpolation process; 
C23. After the rate is determined in this way and t 
and/or second interpolation processing is executed, in s 
blending of pixel data of interpolations is performed, a 
to the following equation, where the set rate shall be 
and then pixels of interpolations are generated in st 



ing unit 
e first 
tj:ep S320, 
cording 
signed, 
ap S32G. 



as 



Data to be blended ~ 

(First interpolation) x rate + (Second interpolation) 



x (1 - rate) 



... (1) 



Thus, this step corresponds to the step or fun 
image data blending. If this step is considered 



ction of 
to be 



implemented as part of the organically integrated operation of 

c Kfrrdwarc including the: CPU, it ia deriiiea Llie d^Liuu uf 



4~ V ^ 



the image data blending unit C25. Upon the completion of the 

pixel, judgment is made as to whether blending of interpolated 
data has been completed for *il target pixels in the input source 



image data in step 3322- XI uuL, Llie aUep S30*3 cliiU 

steps are repeated until blending of interpolated data 
completed for all target pixels. 

Upon the completion of blending of interpolated 



has been 
data for 
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all target pixels, printing is executed, based 
interpolation-processed image data-, in step S324. 



printer driver 12c, print data is not obtained only by resolution 
conversion; color conversion and half tone processing are further 
required* Thus, such conversion and processing are executed and 
the resultant print data is output to the color printer 17b, The 
processing of this step corresponds to the step or function of 
print control processing. If this step is considered to be 
implemented as part of the organically integrated operation of 
the hardware including the CPU, it is defined as the action of 
the print control processing unit C26. 

Then, detailed processing for each step in the above 
flowchart will be explained below. In the present embodiment, 
judgment is made as to whether the source image acquired in the 
step S3D2 belongs to computer graphics (non-natural pictures) 
or photography (natural pictures} and the result of the judgment 
a& well t*^ tiit; piiui quality parameters are renectea an setting 
a blending ratio between the first and second interpolations . 
To prevent incorrect selection of an interpolation method to be 
applied, it is, of course, possible to avoid fixing the 
above-mentioned rate to "1" or "0." However, in the present 
embodiment, if the number of discrete luminance values appearing 
in the reference pixels is less than 15, the pixels are regarded 
as those belonging to a non-natural picture • This is because 
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on the 
For the 



the iiivciiuui uuiihiUtsib 1L moxe important to avoid the app:. 
of the second interpolation processing to non-natural p:. 
otherwise, the second interpolation would make contou 
in a non-natural picture. 

For the above judgment, a histogram of luminance 



which is shown in Fig, 14, is used. In the step 104, the luminance 



values of the reference pixels in the zone comprising 5 x 
are obtained and a histogram is created to show how th& 
are distributed in the range of their luminance valu<s 
number of discrete luminance values appearing in the his; 
that is, how many luminance values appear for which th 
of distributed pixels is other than "0" is counted, based cjn which, 
the judgment in the step S306 is made. 

In the histogram of luminance values, if there are 15 
or more luminance values for which the number of distributed 
pixels is other than "0," the blending ratio of the pixels 
interpolated by the above first interpolation processing to 
those interpolated by the second one is determined by the 
appropriate evaluation function ♦ In the present embodiment , two 



e 



valuation functions are prepared beforehand: one for hi 



ication 
ctures; 
s vague 

values, 



5 pixels 
pixels 
s • The 
togram, 
number 



gh print 



quality and the other for low print quality. If any one of the 
print parameters set on the window shown in Fig, 32 indicates 
high print quality, the evaluation function for high print 
quality is selected to be used in the step S306. Fig. ^3 gives 
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examples of evaluation functions F (y) : Fi is the evaluation 
function for low print quality and F2 is the evaluation function 
for high print quality. 

.F.or t-^p ^-cr* I nation function Fl (y) , the valuo of " y" t alio 
within the range that 0 ^ y S 255 and varies in the range that 
0 ^ f (y) ^ 1. F (y) is 0 in the range that 0 ^ y ^ 64 and 1 
in the range that 192 ^ y ^ 255. F (y) linearly increases from 
0 to 1 in the ran ge that 64 ^ y ^ 192. Fnr the* ft^lnaHnn 
function F2 (y) , the value of "y" falls within the range that 

0 ^ y < 255 and varies in the range that 0 ^ F (y) S 0.7- F 
(y) is 0 in the range that 0 ^ y ^ 64 and 0.7 in the ra.ige that 
192 5 y ^ 255. F <y> linearly increases from 0 to 0 . 7 in the 
range that 64 ^ y ^ 192. 

Hereupon, the width of the range within which the 
luminance values falls, "Ymax - Ymin, " shown in Fig. 14, is 
assigned to "y." Thus r the greater this width value, i:hat is, 
the reference pixels make edge-like visualization due to mutual 
relation in luminance, the greater will be the rate. Even at 
the same width value, the value of the evaluation function Fl 
is always greater than the value of the evaluation function F2 , 
This means that, for high print quality, even at the saine width 
val up ; the blending ratio of the pixels interpolated by the second 
interpolation processing by which interpolation is executed 
-without- dire^Liiiy Lhe yiadation of the tones to the pixels 
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interpolated by the first interpolation becomes grea 

When "high resolution of print, " "high printing 
quality," and/or "low print speed" are selected, 
printing for high print quality is executed, by execu 
interpolation not affecting the gradation of the tone 
source image, subtle tone gradation is reproduced as th 
visible to the user on the image produced by printing, 
other hand, when printing for low print quality is execut 
if print data from which subtle tone gradation is re 
is used for printing, such gradation is not reproduced 
effect visible to the user on the image produced by pj: 
Thus, it can be said that the second interpolation 
is worthy of being executed when high print quality is de 
In the present embodiment, by using the evaluation funcjt 

the ~1j"T" hiki I r i rj r^tin of the pixels interpolated by th« 

interpolation processing to those interpolated by the f 
is set high. 

In the present embodiment, the ink type select 
influences the selection between the above evaluation 



proces 



f unct 



Selection can be made between "pigment" and "dye" as 
which is of high quality cannot be determined easily, 
due to its property, pigment ink does not easily blur as 
with dye and tends to highlight the edge contrast on 
produced by printing. Thus, it can be said that i 
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embodiment , 



the 



selection reflects print quality- In the present 
to obtain same level print result by using either of 
types, the blending ratio of the pixels interpolated by 
interpolation processing to those interpolated by the f 

should be higher for "pigment" than as for "dye." In the present 
embodiment, the above evaluation function F2 shall be uped when 



both ink 
second 
Irst one 



Vel 



da 



the ink selection is "pigment 

Of course, the manner of reflecting the e 
functions and the settings the above print parameters 
in interpolation in the present embodiment has been 
above for illustrative purposes; a variety of manners 
can be taken. For example , a plurality of evaluation 
can be prepared and they are not necessarily two t 
described above. If there are four discrete print p 
to be set, influencing the print quality, as in th 
embodiment, four evaluation functions may be prepared 
conceivable that each time high quality setting increase^ 
another evaluation function with the maximum value bei 



luation 
4-cquired 
scribed 
thereof 



functions 



should be selected. 



In another manner, it is not necessary to 
plurality of evaluation functions beforehand, but ojnly the 
above-mentioned evaluation function Fl should be prepare^. This 
function can be used in the following way. When high quality 
printing is desirable, the value of the evaluation function is 



arame 



ypes as 
ters 
e above 
It is 
by one, 
lower 



^9 



prepare a 
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multiplied by "Q.7" and the rate is determined. Each t 
quality sotting increases by one, the value of the e 
function may be multiplied by "0.9." Furthermore, i 
necessary to restrict the evaluation function curves 



ime high 
luation 
i: is not 
co their 



tha 



Alternat 



examples shown in Fig* 33. Any function may be used 
the characteristic; when the width of the range of the 
values is assumed variable, the function value i 
monotonously as the value of the width increases 
an evaluation function whose value gradually changes 
range of luminance values of 0 to ?SS m*y he hspH. 

Once the evaluation function to be used hs 
determined in the way described above in the step S307, a 
ratio, the rate is determined by using the evaluation 
in step £308. In the histogram shown in Fig. 14, beca 
arc 19 luminance values for which the number of distribute 
is other than "0/ after the affirmative judgment is ma 
step S306, the processing of the step S307 is execute 
resolution of fr 720 dpi, " "glossy print" paper, "high" pri 
and "pigment" ink are selected as shown in Fig. 32, the : 
of the print parameters of resolution, paper, and ink 
the selection of the evaluation function for high 
printing and thus the evaluation function F2 is selecteld 
step S307. Then, the rate is determined by the ev^ 
function F2 in the step S308 and the first inter 



t shows 
luminance 
creases 
ively f 
3ver the 
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processing in the step S314 and the second interpolation 
processing in the step S31B are executed. 

After pixels of interpolates are generated by t 
interpolation processing, if the above rate is not "1, " th 
interpoi<aLiuxi processing is further executedr 



Whet he 

M-cubic method or the normal cubic method is used, oncp 
of interpolations have been generated by the cubic method 
above step of the second interpolation process! 
parameters to be assigned to the above calculation equa 
for data to be blended are now obtained: i.e., data gene 



nig 



by the second interpolation processing. By assignii^ 
parameters to the equation (1), calculation of the p 
interpolations data to be blended at a ratio between t 



and second interpolations is executed. 

Hereupon, according to the settings shown in fig. 32, 
high print quality is set and subtle tone gradation] can be 
reflected in the print result in this state. - At th^s time, 
because the evaluation function is F2, the blending ratio of the 
pixels interpolated by cubic method to those interpolated by the 
first interpolation is set high. 

On the other hand, if resolution of "360 dpi," "plain* 
paper, "hicfh" print- 5?peed, and "dye" ink are selectpqi on the 
window shown in Fig. 32, low print quality is set and thfe effect 
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highlight 



of the second interpolation processing is not noticeab 
this state, the above-mentioned evaluation function FjL 
be used and the blending ratio of the pixels interpolate 
second interpolation processing to those interpolated 
first interpolation should be set lower in contrast with 
state of the settings shown in -Fig* 32. At this time 
is the blending ratio of the pixels interpolated by 
matching method or nearest method by which the edge is 
to the pixels interpolated by the cubic method by which th 
of tones are exactly reproduced. Sharp print result 
obtained, though the print quality is low. 

Finally, a general view of the present 
(second) of the invention is shown in Fig. 35. 

The "Print Setup" window, when displayed, allows 
to set the print parameters that are varied, dependi 
printer-specific capability. The settings of these pa 
are stored into the setup file. If these par 
previously been set r the setup file is referred to and r 
the operator changes the settings for print operati 
updated settings are read. The thus set print parame 
input in the step S303 that corresponds to the action of 
quality parameters acquisition unit C21. 

On the other hand, in the step S304, source im^g 
is scanned a histogram of the luminance values of the p 
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the zone comprising 5x5 pixels around the target pixel is 
In the step S30 6, the number of discrete luminance 
appearing in the created histogram is counted. If th 
is less than a predetermined threshold, the attribute of 



the 



roce 



is regarded as a simple non-natural picture and a blending 
(rate) of interpolations by the first interpolation p 
to those by the second interpolation processing is set t 
the count is greater than the threshold, the attribut 
image is regarded as a natural picture or a mixed image of 
and non-natural pictures and an evaluation function F is 
by which the rate should be determined- Seiectio^i 
evaluation function F depends on the print quality s 
there are two evaluation functions: evaluation functio 



set** 



low image quality and evaluation function F2 for hi 
quality- The evaluation functions F are functions 
difference between the maximum luminance value Ymax 



created. 

values 
.s count 
image 



ratio 
ssing 
o 1. If 
> of the 
natural 
lected 
of an 
ing and 
h Fl for 



gh 



minimum luminance value Ymin in the above zone and set the rate 
by evaluating edge-like visualization. For visualization that 
is more edge-like, the evaluation function Fl is applied and the 
percentage of such interpolation is set high that tjends to 
highlight the edge and involves a relatively low load of 
arithmetic processing. For less edge-like visualization, the 
evaluation function F2 is applied and the percentage of such 
interpolation is set high that smoothes the edge and involves 
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a high load of arithmetic processing. The unit to determine a 
blending ratio in this way, depending on whether print: quality 
is high or low, is the second unit of determining a blending ratio 
C24 . 

In the step S314, interpolation processing is executed 
within, the predetermined zone around the target pixel by the 
pattern matching method or the nearest method. The 
interpo] ation that tends to keep the edge intact is carried out 
by the first interpolation processing unit C22 

On the other hand, in the step S318, interpolation 
processing is executed by the cubic method in which suHle tone 
difference between the pixels is reflected P while the edge is 
made vaque, as contrasted with the* e*drr& m^H** "hy_-±\h.e pattern 
matching method- This interpolation is carried out by ttye second 
interpolation processing unit C23 

Then, in the step S320, the data of pixels separately 
interpolated by the first and second interpolations are weighted 
and ddded by the equation (1) to which the blending ratio [rate) 



determined as described above is assigned and blended p 



ixels of 



first and second interpolations are generated* The total sum 



of the blending ratio, of course, becomes "1," This 
carried out by the image data blending unit C25. 

Following that, the above procedure is repeated 



target pixel being changed until all target pixels have been 



step is 



with the 
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processed. Then, an interpolation-processed image is 
In the step S324, the completely interpolation-process 
data is supplied to the printer 17b where printing is 
This step is carried out by the print control process 
C26. 



created . 
ed image 
cuted. 
ing unit 



exe 



As explained above, in the present invention, th|e pixels 
interpolated by the first interpolation processing and the 
pixels interpolated by the second interpolation processing are 
blended, based on a predetermined evaluation function. The thus 
blended pixels show the characteristics that the edge is made 
vaguer than the edge made by the pattern matching methpd only 
but sharper than the edge made by the cubic method onlyl. These 
pixels are also characterized in that the fineness of sufctle tone 
gradation decreases as contrasted with those interpolated by the 
cubic method only, whereas tone graduation is colorful as 
contrasted with those interpolated by the pattern matching 
method only. Because the above evaluation function is a function 
of the width of the range within which the obtained ltiminance 
values fall, a ratio between the two modes of interpolation 
processing can be determined, according to the attribute of the 
source image. Furthermore, the blending ratio of th<s pixels 
interpolated by the interpolation processing taken to be more 
suitable for the print quality settings that directly influence 
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interpolated by the other interpolation processing is 
In consequence, the merit of each mode of inte 
processing becomes more noticeable, whereas the derneri 
becomes mild. Thus, the present invention enables 
interpolation proceeding, according to the print 
settings, while preventing an error in select 
interpolation method, based on the appraised attribut 
image for which interpolation is executed. 
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